Multimedia providing service

ABSTRACT

At one of the timings: during a period between the moment when one of terminals which performs transmission calls out a communication partner and the moment of response and at the timing after the communication between the terminals is complete; a server reads out content data from a database and transmits the read out content data to the terminal. At this timing, the terminal reproduces the content data transmitted from the server.

TECHNICAL FIELD

The present invention relates to a method of providing a multimediaservice in a multimedia communication system that performs multimediacommunication.

BACKGROUND ART

The wider bandwidth of IP networks in recent years has been accompaniedby the popularization of videophone terminals that carry out multimediacommunication of both speech and images. Multimedia communication takesadvantage of the properties of “images” that did not exist inconventional voice communication to not only allow conversation in whichpartners can see each other but also to meet a wide variety of otherservice needs.

However, while the originator terminal is calling the termination-sideterminal (before the terminator terminal responds), images of, forexample, desired advertising were not displayed on the originatorterminal or terminator terminal.

In addition, during a call between terminals, desired advertising wasnot inserted into images displayed on the originator terminal orterminator terminal.

However, techniques have been considered for transmitting desiredadvertisement data to a terminal when a communication path is connectedbetween terminals (for example, refer to JP-A-2000-201229,JP-A-2005-033442).

However, nothing is described in the above-described patent documentsregarding information for reproducing the data in the originatorterminal. In addition, nothing is disclosed regarding combination suchas for advertisement data.

DISCLOSURE OF THE INVENTION

It is an object of the present invention to solve the above-describedproblems by providing a method in which a multimedia service can providea service of reproducing desired content data in a terminal at aprescribed timing and in a format appropriate to the content data.

The present invention for achieving the above-described object is amethod of providing a multimedia service in a multimedia communicationsystem that is made up from a plurality of terminals and a server, theserver being connected to the plurality of terminals, the serverprocessing call process signals of the plurality of terminals, andhaving a database in which are stored content data; the methodcomprising steps wherein:

the server reads the content data from the database at either thetimings of:

(a) the interval from the time a call is made by a terminal, thatperforms call origination among the plurality of terminals, to aterminal among the plurality of terminals that is the communicationpartner of the terminal that performs call origination, until theterminal responds; or

(b) after communication between the terminals is completed;

at the timing, the server transmits the content data that were read tothe terminals; and

at the timing, the terminals reproduce content data that weretransmitted from the server.

Further, the present invention is a method of providing a multimediaservice in a multimedia communication system that is made up from aplurality of terminals and a server, the server being connected to theplurality of terminals, the server processing call process signals ofthe plurality of terminals, and having a database in which are storedcharacter strings that can be displayed on the terminals; the methodcomprising steps wherein:

after the terminal that is the communication partner of the terminalthat performs call origination responds, the server reads the characterstring from the database;

the server inserts the character string that was read into image datathat are transmitted and received between the terminal that performscall origination and the terminal that is the communication partner ofthe terminal that performs call origination;

the server transmits to the terminals image data into which thecharacter string was inserted; and

the terminals reproduce image data into which the character string wasinserted and that were transmitted from the server.

Further, the present invention is a method of providing a multimediaservice in a multimedia communication system made up from a plurality ofterminals and a server, the server being connected to the plurality ofterminals, processing call process signals of the plurality ofterminals, and having a database that stored content data; the methodcomprising steps wherein:

the server reads the content data from the database in accordance witheither:

(a) a read signal that corresponds to a key that is entered, when theread signal is transmitted to the server by an origination-side terminalthat is a terminal that performs call origination among the plurality ofterminals; or

(b) a read signal that corresponds to a key that is entered, when theread signal is transmitted to the server by a termination-side terminalthat is a terminal that is the communication partner of theorigination-side terminal among the plurality of terminals;

the server transmits to at least one terminal from among theorigination-side terminal and the termination-side terminal the contentdata that were read; and

the terminals reproduce content data that were transmitted from theserver.

Further, the present invention is a method of providing a multimediaservice in a multimedia communication system that is made up from aplurality of terminals and a server, the server being connected to theplurality of terminals, the server processing call process signals ofthe plurality of terminals, and having a database in which are storedcharacter strings that can be displayed on the terminals; the methodcomprising steps wherein:

the server reads the character string from the database in accordancewith either:

(a) a read signal transmitted from the origination-side terminal that isthe terminal that performs call origination among the plurality ofterminals; or

(b) a read signal transmitted from the termination-side terminal that isthe terminal that is the communication partner of the origination-sideterminal among the plurality of terminals;

the server inserts the character string that was read into image datathat are transmitted and received between the origination-side terminaland the termination-side terminal;

the server transmits to the terminals image data into which thecharacter string is inserted; and

the terminals reproduce image data into which the character string wasinserted and that were transmitted from the server.

In the present invention as described hereinabove, a configuration isadopted in a system that transmits and receives images and speech inwhich content data that have been stored in advance in a database aretransmitted to a terminal at a prescribed timing, whereby a service canbe provided for reproducing desired content data in a terminal at aprescribed timing and in a format that is appropriate to the contentdata.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 shows an embodiment of the multimedia communication system of thepresent invention;

FIG. 2 shows the first embodiment of the multimedia communication deviceshown in FIG. 1;

FIG. 3 shows one configuration of the transmission data switch unitshown in FIG. 2;

FIG. 4 shows one construction of the content database shown in FIG. 2;

FIG. 5 is a flow chart for explaining the first method of the multimediacommunication method in the multimedia communication device shown inFIG. 2;

FIG. 6 shows one embodiment of the origination-side terminal shown inFIG. 1;

FIG. 7 shows one construction of the conversion information databaseshown in FIG. 2;

FIG. 8 shows one configuration of the data converter shown in FIG. 3when syntax conversion is carried out;

FIG. 9 is a flow chart for explaining the second method of themultimedia communication method in the multimedia communication deviceshown in FIG. 2;

FIG. 10 shows the second embodiment of the multimedia communicationdevice shown in FIG. 1;

FIG. 11 is a flow chart for explaining the first method of themultimedia communication method in the multimedia communication deviceshown in FIG. 10;

FIG. 12 shows an embodiment of the termination-side terminal shown inFIG. 1;

FIG. 13 is a flow chart for explaining the second method of themultimedia communication method in the multimedia communication deviceshown in FIG. 10;

FIG. 14 shows the third embodiment of the multimedia communicationdevice shown in FIG. 1;

FIG. 15 shows the fourth embodiment of the multimedia communicationdevice shown in FIG. 1;

FIG. 16 shows one configuration of the transmission data characterinsertion unit shown in FIG. 15;

FIG. 17 shows one configuration of the character string database shownin FIG. 15;

FIG. 18 is a flow chart for explaining the multimedia communicationmethod in the multimedia communication device shown in FIG. 15;

FIG. 19 shows the fifth embodiment of the multimedia communicationdevice shown in FIG. 1;

FIG. 20 is a flow chart for explaining the multimedia communicationmethod in the multimedia communication device shown in FIG. 19;

FIG. 21 shows the sixth embodiment of the multimedia communicationdevice shown in FIG. 1;

FIG. 22 shows the seventh embodiment of the multimedia communicationdevice shown in FIG. 1;

FIG. 23 is a flow chart for explaining the multimedia communicationmethod in the multimedia communication device shown in FIG. 22;

FIG. 24 shows the eighth embodiment of the multimedia communicationdevice shown in FIG. 1;

FIG. 25 is a flow chart for explaining the multimedia communicationmethod in the multimedia communication device shown in FIG. 24;

FIG. 26 shows the ninth embodiment of the multimedia communicationdevice shown in FIG. 1;

FIG. 27 shows the tenth embodiment of the multimedia communicationdevice shown in FIG. 1;

FIG. 28 is a flow chart for explaining the multimedia communicationmethod in the multimedia communication device shown in FIG. 27;

FIG. 29 shows the eleventh embodiment of the multimedia communicationdevice shown in FIG. 1;

FIG. 30 is a flow chart for explaining the multimedia communicationmethod in the multimedia communication device shown in FIG. 29;

FIG. 31 shows the twelfth embodiment of the multimedia communicationdevice shown in FIG. 1;

FIG. 32 shows the thirteenth embodiment of the multimedia communicationdevice shown in FIG. 1;

FIG. 33 shows one configuration of the advertisement content databaseshown in FIG. 32;

FIG. 34 shows the fourteenth embodiment of the multimedia communicationdevice shown in FIG. 1;

FIG. 35 shows one construction of the preferential treatment informationdatabase in which the number of transmissions of advertisement data andpreferential treatment information are placed in correspondence; and

FIG. 36 shows one construction of the preferential treatment informationdatabase in which the transmission time of advertisement data andpreferential treatment information are placed in correspondence.

EXEMPLARY EMBODIMENT

Explanation next regards embodiments of the present invention withreference to the accompanying figures.

FIG. 1 shows one embodiment of the multimedia communication system ofthe present invention.

As shown in FIG. 1, in the present embodiment, a plurality of terminals102-1-102-n and multimedia communication device 103 are connected by wayof network 101.

Terminals 102-1-102-n are communication terminals that can berepresented by videophone terminals that can transmit and receive imagesand speech. Terminals 102-1-102-n can each originate calls and terminatecalls. Terminals 102-1-102-n each encode, as speech data, speech that iscollected by a speech collection means such as a microphone provided oneach of terminals 102-1-102-n and transmit the encoded speech data.Terminals 102-1-102-n further each encode, as image data, images thatare captured by a capture means such as a camera provided on each ofterminals 102-1-102-n and transmit the encoded image data. Terminals102-1-102-n further decode speech from the received speech data andreproduce the decoded speech by means of a speech reproduction meanssuch as a speaker that is provided on each of terminals 102-1-102-n.Terminals 102-1-102-n further decode images from received image data andreproduce the decoded images by means of an image reproduction meanssuch as a display provided on each of terminals 102-1-102-n.

Multimedia communication device 103 intermediates the transfer of speechdata and image data that are transmitted and received between terminals102-1-102-n by way of network 101. Multimedia communication device 103additionally has the role of server for transmitting any content orcharacter string to terminals 102-1-102-n.

First Embodiment

Explanation first regards the first embodiment of multimediacommunication device 103 shown in FIG. 1.

FIG. 2 shows the first embodiment of multimedia communication device 103shown in FIG. 1. An example is here shown in which communication iscarried out between terminals 102-1 and 102-2. In this case, terminal102-1 is the origination-side terminal and terminal 102-2 is thetermination-side terminal that is the communication partner of terminal102-1. In addition, the operations of terminals 102-3-102-n areidentical to the operations shown below regardless of which amongterminals 102-3-102-n is the origination-side terminal ortermination-side terminal.

As shown in FIG. 2, the first embodiment of multimedia communicationdevice 103 shown in FIG. 1 is made up from: call process signalprocessor 201, origination-side terminal data transmitter 202,transmission data switch unit 203, termination-side terminal datareceiver 204, origination-side terminal data receiver 205,termination-side terminal data transmitter 206, and content database207.

Call process signal processor 201 transmits and receives call processsignals between terminal 102-1 and terminal 102-2. In addition, thereproduction environment information (information that indicates theenvironment in which content data reproduced) of encoded data that aretransmitted and received between terminal 102-1 and terminal 102-2 isalso transmitted and received between terminal 102-1 and terminal 102-2.In this case, the reproduction environment information of encoded datais information necessary for reproducing the encoded data on terminals102-1 and 102-2, and may be, for example, information for receiving theencoded data (the address, port, format, application for reproduction,etc.) or a bandwidth value used in the encoded data. A protocol such asSDP (Session Description Protocol: RFC2327) of the IETF standards may beused in the transmission and reception of this reproduction environmentinformation. In addition, call process signal processor 201 issuesinstructions to transmission data switch unit 203 to read content fromcontent database 207 at a prescribed time or at the timing of receptionof call process signals from terminal 102-1 or terminal 102-2. Callprocess signal processor 201 further issues instructions to transmissiondata switch unit 203 to transmit content that has been read from contentdatabase 207 to terminal 102-1 at a prescribed time or at the timing ofreception of call process signals from terminal 102-1 or terminal 102-2.Alternatively, call process signal processor 201 issues instructions totransmission data switch unit 203 to transmit encoded data that havebeen transmitted from terminal 102-2 and received in multimediacommunication device 103 to terminal 102-1 at a prescribed time or atthe timing of reception of call process signals from terminal 102-1 orterminal 102-2. Call process signal processor 201 can use a protocolsuch as SIP (Session Initiation Protocol: RFC3261) of the IETF standardsas the call process signals.

Origination-side terminal data transmitter 202 transmits encoded datasupplied from transmission data switch unit 203 to terminal 102-1.

Transmission data switch unit 203 reads content from content database207 in accordance with instructions from call process signal processor201 and encodes the content. In addition, in accordance withinstructions from call process signal processor 201, transmission dataswitch unit 203 switches the encoded data supplied to origination-sideterminal data transmitter 202 to that of encoded data of content thathas been read from content database 207 and then to encoded and encodeddata that are supplied from termination-side terminal data receiver 204(encoded data that are transmitted from terminal 102-2).

FIG. 3 shows the configuration of transmission data switch unit 203shown in FIG. 2.

As shown in FIG. 3, transmission data switch unit 203 shown in FIG. 2 ismade up from content read unit 301, selector 302, and data converter303.

Content read unit 301 reads content from content database 207 andencodes the content that has been read as encoded data when there areinstructions from call process signal processor 201 to read content fromcontent database 207.

When instructed from call process signal processor 201 to supplyorigination-side terminal data transmitter 202 with encoded data thathave been supplied from termination-side terminal data receiver 204,selector 302 selects the encoded data that are supplied fromtermination-side terminal data receiver 204. Alternatively, wheninstructed to supply origination-side terminal data transmitter 202 withencoded data of content that have been read from content database 207and encoded, selector 302 selects the encoded data of the content.

Data converter 303 converts encoded data selected in selector 302 to adata format that can be decoded and reproduced in terminal 102-1, whichis the origination-side terminal. This conversion is realized bycarrying out at least one conversion of the conversion information thatis stored in conversion information database 208. The conversioninformation will be explained later. A configuration that lacks thisdata converter 303 is also possible.

Termination-side terminal data receiver 204 receives encoded data thatare transmitted from terminal 102-2 and supplies the encoded data thathave been received to transmission data switch unit 203.

Origination-side terminal data receiver 205 receives the encoded datathat are transmitted from terminal 102-1 and supplies the encoded datato termination-side terminal data transmitter 206.

Termination-side terminal data transmitter 206 transmits the encodeddata that are supplied from origination-side terminal data receiver 205to terminal 102-2.

Content database 207 stores in advance content data such as a pluralityof items of image data of moving images and still images and speechdata. Content database 207 may also store character data as contentdata.

Conversion information database 208 stores in advance conversioninformation for converting data that are transmitted from multimediacommunication device 103 to data that can be decoded and reproduced oneach of terminals 102-1-102-n.

In addition, origination-side terminal data transmitter 202 andtermination-side terminal data transmitter 206 can be constructed as RTP(Real-Time Transport Protocol) packet transmitters when network 101 is apacket-switched network.

Termination-side terminal data receiver 204 and origination-sideterminal data receiver 205 can be configured as RTP packet receiverswhen network 101 is a packet-switched network.

FIG. 4 shows one construction of content database 207 shown in FIG. 2.

As shown in FIG. 4, content database 207 shown in FIG. 2 stores imagedata such as moving images or still images or speech data. Each item ofthe image data or speech data is stored in correspondence withreproduction environment information, a classification, and anidentification number individually conferred to each item of data. Forexample, content that is a moving picture of a ringing portabletelephone is placed in correspondence with identification number “0001,”the classification “image data (moving picture),” and reproductionenvironment information “A.” Content that is a still picture of a risingsun on the horizon is placed in correspondence with identificationnumber “0002,” the classification “image data (still picture),” andreproduction environment information “B.” Content that is a movingpicture in which a character that is moving is placed in correspondencewith identification number “0003,” the classification “image data(moving picture),” and reproduction environment information “C.” Contentthat is the speech “Telephone!” is placed in correspondence withidentification number “0004,” the classification “speech data,” andreproduction environment information “D.”

Content database 207 may be connected to the outside of multimediacommunication device 103, and as necessary, content may be read bymultimedia communication device 103.

Explanation next regards the multimedia communication method inmultimedia communication device 103 shown in FIG. 2.

FIG. 5 is a flow chart for explaining the first method of the multimediacommunication method in multimedia communication device 103 shown inFIG. 2.

First, when call origination from terminal 102-1 to terminal 102-2 shownin FIG. 2 is detected in call process signal processor 201 in Step 1, itis determined whether terminal 102-2, which is the termination-sideterminal, has responded or not in Step 2.

If it is determined in call process signal processor 201 that terminal102-2 has not responded, instructions are issued from call processsignal processor 201 to transmission data switch unit 203 to readcontent from content database 207, encode the data, and supply it toorigination-side terminal data transmitter 202. In accordance with theseinstructions, transmission data switch unit 203 reads content fromcontent database 207 and encodes the content in Step 3.

At this time, read content that has been read may be content selected inaccordance with the termination-side terminal. In other words, thecorrespondence between the identification number of content andinformation for identifying terminals 102-1-102-n may be stored inadvance in content database 207, and content is then selected inaccordance with this correspondence and read. For example, a case willshown in which information for identifying terminal 102-2 andidentification number “0002” are placed in correspondence. At this time,when the termination-side terminal is terminal 102-2, the content havingthe identification number “0002” may be read. Alternatively, content maybe selected and read in accordance with the origination-side terminal.In this case, information for identifying the termination-side terminaland origination-side terminal is supplied from call process signalprocessor 201 to transmission data switch unit 203. Here, theinformation for identifying terminals 102-1-102-n may be the telephonenumbers of terminals 102-1-102-n, or may be information that canidentify terminals 102-1-102-n.

In addition, together with the content, reproduction environmentinformation that is placed in correspondence with this content is readfrom content database 207, and the reproduction environment informationthat has been read is supplied from transmission data switch unit 203 tocall process signal processor 201. The reproduction environmentinformation that is applied as input to call process signal processor201 is transmitted from call process signal processor 201 to terminal102-1 in Step 4.

The encoded data of the content that has been encoded are supplied toorigination-side terminal data transmitter 202 in Step 5.

The encoded data of this content are then transmitted fromorigination-side terminal data transmitter 202 to terminal 102-1.

When it is determined in call process signal processor 201 that terminal102-2 has responded, the reproduction environment informationtransmitted in from terminal 102-2 is received in call process signalprocessor 201 and transmitted from call process signal processor 201 toterminal 102-1 in Step 6. The reproduction environment informationtransmitted in from terminal 102-2 is reproduction environmentinformation relating to data that are transmitted in from terminal102-2.

Instructions are issued from call process signal processor 201 totransmission data switch unit 203 to supply encoded data fromtermination-side terminal data receiver 204 to origination-side terminaldata transmitter 202. In accordance with these instructions, intransmission data switch unit 203, encoded data supplied from terminaldata receiver 204 are supplied to origination-side terminal datatransmitter 202 in Step 7.

The encoded data are then transmitted from origination-side terminaldata transmitter 202 to terminal 102-1.

Reproduction environment information relating to data that aretransmitted in from terminal 102-2 may be registered in advance in callprocess signal processor 201. In this case, in Step 4, the reproductionenvironment information of content may be transmitted to terminal 102-1and reproduction environment information relating to data that aretransmitted in from preregistered terminal 102-2 may further betransmitted to terminal 102-1.

FIG. 6 shows an embodiment of terminal 102-1 shown in FIG. 1. Inaddition, of the form of terminal 102-1 shown in FIG. 1, FIG. 6 showsonly the reception function parts relating to the present invention.

As shown in FIG. 6, terminal 102-1 shown in FIG. 1 is provided withreproduction capability determination unit 601, received dataidentification unit 602, speech data reproduction unit 603, image datareproduction unit 604, and call process signal processor 605.

Reproduction capability determination unit 601 decodes encoded data thatare transmitted from multimedia communication device 103 and determineswhether the decoded data can be reproduced on terminal 102-1. Thedetermination criteria follow information reported from call processsignal processor 605 of whether terminal 102-1 is calling terminal 102-2or is in a call. When terminal 102-1 is calling terminal 102-2 or is ina call, it is determined that data that are transmitted from multimediacommunication device 103 are data that can be reproduced on terminal102-1. It may further be determined whether data that are transmittedfrom multimedia communication device 103 is content that has been readfrom content database 207 or not. This determination may be carried outby conferring identifiers to prescribed areas of content that are readfrom content database 207 in transmission data switch unit 203 and thenby detecting the conferred identifiers in reproduction capabilitydetermination unit 601. By using these determination criteria, contentthat has been read from content database 207 of data that have beentransmitted from multimedia communication device 103 while terminal102-1 is calling terminal 102-2 is determined to be reproducible. Inaddition, even when data that are transmitted from multimediacommunication device 103 are determined not to be content that has beenread from content database 207, the data transmitted from multimediacommunication device 103 is determined to be reproducible if terminal102-1 is in a call. This is identical to the reproduction function ofimage data and speech data in a typical videophone terminal.

Received data identification unit 602 distinguishes whether the datathat have been determined to be reproducible in reproduction capabilitydetermination unit 601 are speech data or image data. The identificationmethod may be a typical method carried out in the related art.

Speech data reproduction unit 603 reproduces speech data that have beenidentified in received data identification unit 602. Here, whenreproduction environment information has been supplied from call processsignal processor 605, the speech data are reproduced based on thisreproduction environment information. One example of speech datareproduction unit 603 is a speaker.

Image data reproduction unit 604 reproduces image data that have beenidentified in received data identification unit 602. Here, whenreproduction environment information has been supplied from call processsignal processor 605, the image data are reproduced based on thisreproduction environment information. One example of image datareproduction unit 604 is a display.

Call process signal processor 605 processes call process signals. Callprocess signal processor 605 further notifies reproduction capabilitydetermination unit 601 whether terminal 102-1 is calling terminal 102-2or whether terminal 102-1 is in a call. Call process signal processor605 further supplies reproduction environment information that istransmitted from multimedia communication device 103 to speech datareproduction unit 603 and image data reproduction unit 604. Call processsignal processor 605 further transmits reproduction environmentinformation relating to encoded data transmitted from terminal 102-1 tomultimedia communication device 103.

The form of terminal 102-1 shown in FIG. 6 is also the same inembodiments described hereinbelow.

Content that has been read from content database 207 is thus reproducedon terminal 102-1 using reproduction environment information whileterminal 102-1 is calling terminal 102-2. In addition, when the callbegins, the data of images or speech that are transmitted from terminal102-2 are reproduced on terminal 102-1 using reproduction environmentinformation.

The data formats that can be reproduced on terminal 102-1-102-n maydiffer for each terminal. As a result, instructions may be issued fromcall process signal processor 201 to transmission data switch unit 203such that, when encoded data are transmitted to origination-sideterminal data transmitter 202, the encoded data that are transmitted areconverted to a data format that can be decoded and reproduced interminals 102-1-102-n that are the transmission destinations and thenthis data is supplied. In this case, the actual data conversion iscarried out in data converter 303 of transmission data switch unit 203shown in FIG. 3.

FIG. 7 shows the construction of the conversion information databaseshown in FIG. 2.

As shown in FIG. 7, conversion information database 208 shown in FIG. 2stores information for conversion to a data format that can be decodedand reproduced in each of terminals 102-1-102-n in correspondence withidentification numbers that have been individually conferred toterminals 102-1-102-n. In FIG. 7, the identification numbers ofterminals 102-1-102-n are shown as 102-1-102-n, but these identificationnumbers may be any identification numbers that are individuallyconferred to terminals 102-1-102-n and that, when implementing callprocessing, are individually conferred to terminals 102-1-102-n andtransmitted from terminals 102-1-102-n to multimedia communicationdevice 103. In addition, conversion information such as the encodingmethod, encoding bit rate, frame rate, image size, profile, level,encoding options, encoding frame type composition, video packet size,intraframe spacing, intra-macroblock number and quantization value arestored as conversion information. In FIG. 7, the columns of each item ofinformation are blank, but this omission is only an abbreviation. Thedefinitions of each item of conversion information are shownhereinbelow.

The encoding method is a moving picture compression encoding method suchas ITU-T Recommendation H.263, H.264, or ISO/IEC Recommendation MPEG-4.

The encoding bit rate is the amount of encoding per second whencompressing moving picture images.

The frame rate is the number of frames per second when compressingmoving picture images.

The image size is information of the size of an image that can bereproduced on terminals 102-1-102-n, examples that can be offered beingQCIF (176 picture elements horizontally×144 picture elements vertically)and CIF (352 picture elements horizontally×288 picture elementsvertically).

The profile is the definition of the constituent techniques that areinvolved, examples including resync marker, data partitioning, andreversible VLC in the case of simple profiles in MPEG-4.

Level is a definition of the bit rates or image sizes that are involved,examples including a case in which the maximum image size is QCIF at amaximum bit rate of 64 kbps in the case of Level 1 in MPEG-4.

The encoding options are the optional capabilities when coding, examplesbeing resync markers for strengthening resistance to errors, datapartitioning, and reversible VLC in the case of MPEG-4.

The encoding frame type composition is the type of coding frames, andencoding frame type compositions include intra-mode for implementingin-frame coding and intermode for carrying out coding of interframeprediction differential images.

The video packet size is the packet size of the encoded data for whichencoded data of images can be reproduced on terminals 102-1-102-n, andin the case of MPEG-4, is a unit of encoding made up of resync markersand encoding information that follows the resync markers.

The intraframe spacing is the spacing of frames that have been encodedin intra-mode.

The intra-macroblock number is the number of times encoding has beencarried out in a macroblock in macroblock units realized by partitioninga particular frame. Here, partitioning is in 99 macroblocks in the caseof QCIF.

The quantization value is used in quantizing, which is a process fordecreasing the amount of coding by dividing a coefficient obtainedthrough a DCT (Discrete Cosine Transform) by a particular value that isto be expressed by a coefficient of a small value, the quantizationvalue being the divisor.

These values may be single determined values that are stored, or may bevalues having a prescribed range (width) that are stored.

When the above-described instructions are carried out from call processsignal processor 201, conversion information in terminal 102-1 thatreproduces encoded data is read from conversion information database 208by call process signal processor 201. This conversion information isplaced in correspondence with the identification number of terminal102-1 that is contained in call process signal received in call processsignal processor 201. The conversion information that has been read issupplied from call process signal processor 201 to transmission dataswitch unit 203. Data conversion is then carried out for the encodeddata that are supplied from transmission data switch unit 203 in dataconverter 303 in transmission data switch unit 203 based on theconversion information, whereby encoded data that have been converted toa data format that can be decoded and reproduced in terminal 102-1 aretransmitted from origination-side terminal data transmitter 202 toterminal 102-1.

Alternatively, transmission data switch unit 203 may be configured toone time decode the encoded data that are received as input and thenrecode and supply the data, or may be configured to convert only thesyntax of the encoded data that are received as input and then supplythe data.

FIG. 8 shows the configuration of data converter 303 shown in FIG. 3when syntax conversion is carried out.

As shown in FIG. 8, when syntax conversion is carried out, dataconverter 303 shown in FIG. 3 is composed of: conversion control unit801, reception buffer 802, conversion switches 803 and 807,variable-length decoder 804, parameter order converter 805,variable-length encoder 806, and transmission buffer 808.

Conversion control unit 801 receives DCI (Decoder ConfigurationInformation) that is supplied from call process signal processor 201,compares the pre-conversion DCI and the post-conversion DCI, andsupplies conversion control information. The conversion in this case isconversion of at least one information item from among: the encodingmethod, encoding bit rate, frame rate, image size, profile, level,encoding options, encoding frame type composition, video packet size,intraframe spacing, intra-macroblock number and quantization value indata converter 303. If, as a result of comparison of the pre-conversionDCI and post-conversion DCI, the pre-conversion DCI is found to differfrom the post-conversion DCI, syntax conversion is carried out. On theother hand, if pre-conversion DCI and post-conversion DCI are the same,syntax conversion is not carried out.

Reception buffer 802 first stores moving image data that have beensupplied from termination-side terminal data receiver 204 and thensupplies the data at a prescribed timing.

Conversion switch 803 serves the function of switching betweenconverting or not converting the syntax in video packets supplied fromreception buffer 802 in accordance with conversion control informationthat has been supplied from conversion control unit 801. When syntax isto be converted, conversion switch 803 supplies video packets suppliedfrom reception buffer 802 to variable-length decoder 804. However, whensyntax is not to be converted, conversion switch 803 supplies the videopackets supplied from reception buffer 802 to conversion switch 807.

Variable-length decoder 804 carries out a variable-length decodingprocess upon the video packets supplied from conversion switch 803 usinga normal VLC encoding chart for parameters other than the AC components.Variable-length decoder 804 further has the function of controlling thevariable-length decoding process in accordance with the conversioncontrol information supplied from conversion control unit 801. Regardingthe AC components, variable-length decoder 804 carries out thevariable-length decoding process using a normal VLC encoding chart whenreversible VLC is not used and using an RVLC encoding chart whenreversible VLC is used.

Parameter order converter 805 reorders a bit sequence based on theresults of variable-length decoding in variable-length decoder 804 ofvideo packets supplied from conversion switch 803. This reordering iscarried out based on the MPEG-4 standard, which is a standard forhandling all moving picture/speech as digital data. In addition,parameter order converter 805 has the function of controlling theprocess of reordering a bit sequence in accordance with conversioncontrol information supplied from conversion control unit 801.

Variable-length encoder 806 carries out the process of variable-lengthencoding of only the AC component. Variable-length encoder 806 also hasthe function of controlling the variable-length encoding processaccording to the conversion control information supplied from conversioncontrol unit 801. Variable-length encoder 806 carries out thevariable-length encoding process using a normal VLC coding chart whenreversible VLC is not used and using the RVLC coding chart whenreversible VLC is used.

Conversion switch 807 has the function of switching between convertingor not converting the syntax in video packets supplied from receptionbuffer 802 in accordance with the conversion control informationsupplied from conversion control unit 801. When syntax is to beconverted, conversion switch 807 supplies video packets supplied fromvariable-length encoder 806 to transmission buffer 808. On the otherhand, when syntax is not to be converted, conversion switch 807 suppliesthe video packets supplied from conversion switch 803 to transmissionbuffer 808.

Transmission buffer 808 first stores video packets supplied fromconversion switch 807 and then supplies the video packets toorigination-side terminal data transmitter 202.

A configuration is also possible in which content read from contentdatabase 207 is reproduced on terminal 102-1 after a call has beencompleted between terminal 102-1 and terminal 102-2.

FIG. 9 is a flow chart for explaining the second method of themultimedia communication method in multimedia communication device 103shown in FIG. 2.

When a call is being carried out between terminal 102-1 and terminal102-2, it is determined in call process signal processor 201 whether thecall being carried out between terminal 102-1 and terminal 102-2 hasended or not in Step 11.

When it is determined that the call has ended, instructions are issuedfrom call process signal processor 201 to transmission data switch unit203 to read content from content database 207, encode the content, andsupply the encoded data to origination-side terminal data transmitter202. In accordance with these instructions, transmission data switchunit 203 reads content from content database 207 and encodes the contentin Step 12.

At this time, the content that is read may be content that is selectedin accordance with the termination-side terminal as in the first methodthat was described using FIG. 5. Alternatively, the content may also beselected and read in accordance with the origination-side terminal.

The reproduction environment information that has been placed incorrespondence with the content is also read together with the contentfrom content database 207, and the reproduction environment informationthat has been read is supplied from transmission data switch unit 203 tocall process signal processor 201. The reproduction environmentinformation that is applied as input to call process signal processor201 is transmitted from call process signal processor 201 to terminal102-1 in Step 13.

The encoded data of the content that has been encoded are transmitted toorigination-side terminal data transmitter 202 in Step 14.

The encoded data are then transmitted from origination-side terminaldata transmitter 202 to terminal 102-1.

When transmitting encoded data to terminal 102-1, the encoded data maybe converted in data converter 303 shown in FIG. 3 as in the firstmethod explained using FIG. 5.

Alternatively, a configuration is also possible in which, together withthe transmission of the reproduction environment information of contentto terminal 102-1 in Step 13, reproduction environment informationrelating to data that are transmitted from pre-registered terminal 102-2are transmitted to terminal 102-1.

In this way, after a call has ended between terminal 102-1 and terminal102-2, content that has been read from content database 207 isreproduced on terminal 102-1 using the reproduction environmentinformation. Regarding the time of this reproduction, the reproductionmay be for only a preset time from the end of the call. In this case, atimer for measuring the reproduction time may be provided in multimediacommunication device 103 or may be provided in terminal 102-1.

In the embodiment described hereinabove, when a call takes place fromterminal 102-1 to terminal 102-2, prescribed content is reproduced onterminal 102-1 under conditions suitable to the content and to terminal102-1 while terminal 102-1 is calling terminal 102-2 or after the callbetween terminal 102-1 and terminal 102-2 has ended.

Second Embodiment

Explanation next regards the second embodiment of multimediacommunication device 103 shown in FIG. 1.

FIG. 10 shows the second embodiment of multimedia communication device103 shown in FIG. 1. Explanation here regards a case in which acommunication takes place between terminal 102-1 and terminal 102-2.Terminal 102-1 is the origination-side terminal, and terminal 102-2 isthe termination-side terminal that is the communication partner ofterminal 102-1. The operations of terminals 102-3-102-n are the same asdescribed below regardless of which of terminals 102-3-102-n is theorigination-side terminal or the termination-side terminal.

As shown in FIG. 10, the second embodiment of multimedia communicationdevice 103 shown in FIG. 1 is made up from: call process signalprocessor 1001, origination-side terminal data transmitter 202,transmission data switch unit 203, termination-side terminal datareceiver 204, origination-side terminal data receiver 205,termination-side terminal data transmitter 206, and content database207.

Call process signal processor 1001 carries out the transmission andreception of call process signals between terminal 102-1 and terminal102-2. Call process signal processor 1001 also issues instructions totransmission data switch unit 203 to read content from content database207 at a prescribed time or at the timing of reception of call processsignals from terminal 102-1 or terminal 102-2. In addition, call processsignal processor 1001 issues instructions to transmission data switchunit 203 to transmit the content that has been read from contentdatabase 207 to terminal 102-2 at a prescribed time or at the timing ofreception of call process signals from terminal 102-1 or terminal 102-2.Alternatively, call process signal processor 1001 issues instructions totransmission data switch unit 203 to transmit encoded data transmittedfrom terminal 102-1 and received in multimedia communication device 103to terminal 102-2 at a prescribed time or at the timing of reception ofcall process signals from terminal 102-1 or terminal 102-2. Call processsignal processor 1001 can also use, for example, SIP of the IETFstandards as the call process signals.

Origination-side terminal data transmitter 202 transmits encoded datathat have been supplied from termination-side terminal data receiver 204to terminal 102-1. The processes in origination-side terminal datatransmitter 202 are the same as the processes in origination-sideterminal data transmitter 202 in the first embodiment.

Transmission data switch unit 203 reads content from content database207 and encodes the content in accordance with instructions from callprocess signal processor 1001. In addition, in accordance withinstructions from call process signal processor 1001, transmission dataswitch unit 203 switches the encoded data that is supplied totermination-side terminal data transmitter 206 to either the encodeddata of content that has been read from content database 207 and hasbeen encoded or encoded data that have been supplied fromorigination-side terminal data receiver 205 (encoded data that aretransmitted from terminal 102-1). The processes in transmission dataswitch unit 203 are the same as the processes in transmission dataswitch unit 203 in the first embodiment.

Termination-side terminal data receiver 204 receives encoded datatransmitted from terminal 102-2 and supplies the data toorigination-side terminal data transmitter 202. The processes intermination-side terminal data receiver 204 are the same as theprocesses in termination-side terminal data receiver 204 in the firstembodiment.

Origination-side terminal data receiver 205 receives encoded data thathave been transmitted from terminal 102-1 and supplies the encoded datathat have been received to transmission data switch unit 203. Theprocesses in origination-side terminal data receiver 205 are the same asthe processes in origination-side terminal data receiver 205 in thefirst embodiment.

Termination-side terminal data transmitter 206 transmits the encodeddata supplied from transmission data switch unit 203 to terminal 102-2.The processes in termination-side terminal data transmitter 206 are thesame as the processes in termination-side terminal data transmitter 206in the first embodiment.

Content database 207 is the same as in the first embodiment. Inaddition, of the type of constructions of content database 207 in thefirst embodiment (shown in FIG. 4), content database 207 may be the typeof construction in which reproduction environment information is notstored.

Conversion information database 208 is the same as in the firstembodiment.

The following explanation regards the multimedia communication method inmultimedia communication device 103 shown in FIG. 10.

FIG. 11 is a flow chart for explaining the first method of themultimedia communication method in multimedia communication device 103shown in FIG. 10.

First, upon the detection in call process signal processor 1001 of callorigination from terminal 102-1 to terminal 102-2 shown in FIG. 10, callprocess signal processor 1001 determines in Step 22 whether terminal102-2, that is the termination-side terminal, has responded or not.

If it is determined in call process signal processor 1001 that terminal102-2 has not responded, call process signal processor 1001 issuesinstructions to transmission data switch unit 203 to read content fromcontent database 207, encode the content, and supply the encoded data totermination-side terminal data transmitter 206. In accordance with theseinstructions, transmission data switch unit 203 reads content fromcontent database 207 and encodes the content in Step 23 and supplies theencoded data of the content that has been encoded to termination-sideterminal data transmitter 206 in Step 24.

At this time, the read content may be content that has been selected inaccordance with termination-side terminal as in the first embodiment, orthe content may be selected and read in accordance with theorigination-side terminal.

The encoded data of the content is then transmitted to terminal 102-2from termination-side terminal data transmitter 206.

On the other hand, when it is determined in call process signalprocessor 1001 that terminal 102-2 has responded, call process signalprocessor 1001 issues instructions to transmission data switch unit 203to supply the encoded data that have been supplied from origination-sideterminal data receiver 205 to termination-side terminal data transmitter206. In accordance with these instructions, transmission data switchunit 203 supplies the encoded data that have been supplied fromorigination-side terminal data receiver 205 to termination-side terminaldata transmitter 206 in Step 25. The encoded data are then transmittedfrom termination-side terminal data transmitter 206 to terminal 102-2.

FIG. 12 shows an embodiment of terminal 102-2 shown in FIG. 1. Of theform of terminal 102-2 shown in FIG. 1, FIG. 12 shows only the receptionfunction parts relating to the present invention.

As shown in FIG. 12, terminal 102-2 shown in FIG. 1 is provided withreproduction capability determination unit 1201, received dataidentification unit 1202, speech data reproduction unit 1203, image datareproduction unit 1204, and call process signal processor 1205.

Reproduction capability determination unit 1201 decodes the encoded datathat are transmitted in from multimedia communication device 103 anddetermines whether the decoded data can be reproduced on terminal 102-2.The determination criteria depend on the determination of whetherterminal 102-1 is calling terminal 102-2 or whether terminal 102-2 is ina call or not. If terminal 102-1 is calling terminal 102-2, or ifterminal 102-2 is in a call, the data that have been transmitted frommultimedia communication device 103 are determined to be data that canbe reproduced on terminal 102-2. Reproduction capability determinationunit 1201 may also determine whether the data that have been transmittedfrom multimedia communication device 103 are content that has been readfrom content database 207 or not. This determination may be carried outby conferring identifiers to prescribed areas of content that has beenread from content database 207 in transmission data switch unit 203 andthen detecting the conferred identifiers in reproduction capabilitydetermination unit 1201.

Using these determination criteria, of the data that have beentransmitted from multimedia communication device 103 while terminal102-1 is calling terminal 102-2, content that has been read from contentdatabase 207 can be determined as reproducible.

Even when data that have been transmitted from multimedia communicationdevice 103 are determined not to be content that has been read fromcontent database 207, data that have been transmitted in from multimediacommunication device 103 are determined to be reproducible if terminal102-2 is in a call. This process is the same as the reproductioncapability of image data and speech data in a typical videophoneterminal.

Received data identification unit 1202 identifies if data that have beendetermined to be reproducible in reproduction capability determinationunit 1201 are speech data or image data. The determination method may bea typical method implemented in the related art.

Speech data reproduction unit 1203 reproduces speech data that have beenidentified in received data identification unit 1202. One example ofspeech data reproduction unit 1203 that can be offered is a speaker.

Image data reproduction unit 1204 reproduces image data that have beenidentified in received data identification unit 1202. One example ofimage data reproduction unit 1204 that can be offered is a display.

Call process signal processor 1205 processes call process signals. Inaddition, call process signal processor 1205 also transmits reproductionenvironment information relating to encoded data that are transmittedfrom terminal 102-2 to multimedia communication device 103.

The form of terminal 102-2 shown in FIG. 12 is the same as in theembodiments described hereinbelow.

In this way, content that has been read from content database 207 arereproduced on terminal 102-2 while terminal 102-1 is calling terminal102-2. In addition, the data of images or speech that have beentransmitted from terminal 102-1 are reproduced on terminal 102-2 when acall begins.

In addition, a configuration may be adopted in which content that hasbeen read from content database 207 is reproduced on terminal 102-2after the end of a call between terminal 102-1 and terminal 102-2.

FIG. 13 is a flow chart for explaining the second method of themultimedia communication method in multimedia communication device 103shown in FIG. 10.

When a call is taking place between terminal 102-1 and terminal 102-2,call process signal processor 1001 determines in Step 31 whether thecall that is taking place between terminal 102-1 and terminal 102-2 hasended or not.

If call process signal processor 1001 determines that the call hasended, call process signal processor 1001 issues instructions totransmission data switch unit 203 to read content from content database207, encode the content, and supply the encoded data to termination-sideterminal data transmitter 206. In accordance with these instructions,transmission data switch unit 203 reads content from content database207 and encodes the content in Step 32 and supplies the encoded data ofthe content that has been encoded to termination-side terminal datatransmitter 206 in Step 33.

At this time, the content that is read may be content that is selectedin accordance with the termination-side terminal as in the firstembodiment, or may be content that is selected and read in accordancewith the origination-side terminal.

In this way, after the end of a call between terminal 102-1 and terminal102-2, content that has been read from content database 207 isreproduced on terminal 102-2. Regarding the reproduction time, thecontent may be reproduced for only a preset time interval after the endof a call, in which case a timer for measuring the reproduction time maybe provided in multimedia communication device 103 or provided interminal 102-2.

The data format that can be reproduced in terminals 102-1-102-n maydiffer for each terminal, and as a result, a configuration may beadopted in which call process signal processor 1001 issues instructionsto transmission data switch unit 203 to, when transmitting encoded datato termination-side terminal data transmitter 206, to convert theencoded data that are transmitted to a data format that can be decodedand reproduced in terminals 102-1-102-n that are the transmissiondestinations and to supply the encoded data. In this case, the actualdata conversion is carried out in data converter 303 of transmissiondata switch unit 203 shown in FIG. 3.

When call process signal processor 1001 issues the above-describedinstructions, call process signal processor 1001 reads the conversioninformation in terminal 102-2 that reproduces the encoded data fromconversion information database 208. This conversion information isplaced in correspondence with the identification number of terminal102-2 that is contained in the call process signals received in callprocess signal processor 1001. The conversion information that is readis supplied from call process signal processor 1001 to transmission dataswitch unit 203. Data conversion is then carried out for the encodeddata that are supplied from transmission data switch unit 203 in dataconverter 303 in transmission data switch unit 203 based on theconversion information, whereby the encoded data that have beenconverted to a data format that can be decoded and reproduced interminal 102-2 are transmitted from termination-side terminal datatransmitter 206 to terminal 102-2. The processes of this data conversionare the same as shown in the first embodiment.

When a call is from terminal 102-1 to terminal 102-2 in the presentembodiment, as described hereinabove, prescribed content is reproducedin terminal 102-2 under conditions appropriate to terminal 102-2 whileterminal 102-1 is calling terminal 102-2 or after the end of a callbetween terminal 102-1 and terminal 102-2.

Third Embodiment

Multimedia communication device 103 provided with both the functions ofthe above-described first embodiment and the functions of the secondembodiment can also be considered.

FIG. 14 shows the third embodiment of multimedia communication device103 shown in FIG. 1. An example is here described in which communicationtakes place between terminal 102-1 and terminal 102-2. Terminal 102-1 isthe origination-side terminal and terminal 102-2 is the termination-sideterminal that is the communication partner of terminal 102-1. Theoperations of terminals 102-3-102-n are the same as describedhereinbelow regardless of which of terminals 102-3-102-n is theorigination-side terminal or the termination-side terminal.

As shown in FIG. 14, the third embodiment of multimedia communicationdevice 103 shown in FIG. 1 is made up from: call process signalprocessor 1401, origination-side terminal data transmitter 202,termination-side terminal data receiver 204, origination-side terminaldata receiver 205, termination-side terminal data transmitter 206,content database 207, and transmission data switch unit 1402.

Call process signal processor 1401 carries out transmission andreception of call process signals between terminal 102-1 and terminal102-2. Call process signal processor 1401 transmits and receives betweenterminal 102-1 and terminal 102-2 the reproduction environmentinformation of encoded data that are to be transmitted and receivedbetween terminal 102-1 and terminal 102-2. The transmission andreception of this reproduction environment information may employ, forexample, SDP protocol of the IETF standard. Call process signalprocessor 1401 further issues instructions to transmission data switchunit 1402 to read content from content database 207 at a prescribed timeor at the timing of the reception of call process signals from terminal102-1 or terminal 102-2. Call process signal processor 1401 also issuesinstructions to transmission data switch unit 1402 to transmit contentthat has been read from content database 207 to terminal 102-2 at aprescribed time or at the timing of reception of call process signalsfrom terminal 102-1 or terminal 102-2. Alternatively, call processsignal processor 1401 issues instructions to transmission data switchunit 1402 to transmit encoded data that have been transmitted fromterminal 102-1 and received in multimedia communication device 103 toterminal 102-2 at a prescribed time or at the timing of reception ofcall process signals from terminal 102-1 or terminal 102-2. Call processsignal processor 1401 further issues instructions to transmission dataswitch unit 1402 to transmit content that has been read from contentdatabase 207 to terminal 102-1 at a prescribed time or at the timing ofreception of call process signals from terminal 102-1 or terminal 102-2.Alternatively, call process signal processor 1401 issues instructions totransmission data switch unit 1402 to transmit encoded data that havebeen transmitted from terminal 102-2 and received in multimediacommunication device 103 to terminal 102-1 at a prescribed time or atthe timing of reception of call process signals from terminal 102-1 orterminal 102-2. In addition, call process signal processor 1401 can use,for example, SIP of the IETF standard as the call process signals.

Origination-side terminal data transmitter 202 transmits encoded datathat have been supplied from transmission data switch unit 1402 toterminal 102-1. The processes in origination-side terminal datatransmitter 202 are the same as the processes in origination-sideterminal data transmitter 202 in the first and second embodiments.

Termination-side terminal data receiver 204 receives the encoded datathat have been transmitted from terminal 102-2 and supplies the data totransmission data switch unit 1402. The processes in termination-sideterminal data receiver 204 are the same as the processes intermination-side terminal data receiver 204 in the first and secondembodiments.

Origination-side terminal data receiver 205 receives the encoded datathat have been transmitted from terminal 102-1 and supplies the encodeddata that have been received to transmission data switch unit 1402. Theprocesses in origination-side terminal data receiver 205 are the same asthe processes in origination-side terminal data receiver 205 in thefirst and second embodiments.

Termination-side terminal data transmitter 206 transmits the encodeddata that have been supplied from transmission data switch unit 1402 toterminal 102-2. The processes in termination-side terminal datatransmitter 206 are the same as the processes in termination-sideterminal data transmitter 206 in the first and second embodiments.

Content database 207 is the same as in the first and second embodiments.

Conversion information database 208 is the same as in the first andsecond embodiments.

Transmission data switch unit 1402 reads content from content database207 and encodes the content in accordance with instructions from callprocess signal processor 1401. Transmission data switch unit 1402 also,in accordance with instructions from call process signal processor 1401,switches the encoded data that are to be supplied to origination-sideterminal data transmitter 202 to either encoded data of content that hasbeen read from content database 207 and has been encoded or encoded datathat have been supplied from termination-side terminal data receiver 204(encoded data transmitted from terminal 102-2). Transmission data switchunit 1402 also, in accordance with instructions from call process signalprocessor 1401, switches the encoded data to be supplied totermination-side terminal data transmitter 206 to either encoded data ofcontent that has been read from content database 207 and has beenencoded or encoded data that have been supplied from origination-sideterminal data receiver 205 (encoded data that have been transmitted fromterminal 102-1). Transmission data switch unit 1402 is of a form inwhich transmission data switch unit 203 in the first and secondembodiments is provided with two directions: the data direction from theoriginator terminal to the terminator terminal and the data directionfrom the terminator terminal to the originator terminal.

By means of this form, multimedia communication device 103 can berealized that is provided with both the functions of the firstembodiment and the functions of the second embodiment.

Fourth Embodiment

FIG. 15 shows the fourth embodiment of multimedia communication device103 shown in FIG. 1. An example is here described in which communicationis realized between terminal 102-1 and terminal 102-2. In addition,terminal 102-1 is the origination-side terminal, and terminal 102-2 isthe termination-side terminal that is the communication partner ofterminal 102-1. In addition, the operations in terminals 102-3-102-n arethe same as described below regardless of which of terminals 102-3-102-nis the origination-side terminal or the termination-side terminal.

As shown in FIG. 15, the fourth embodiment of multimedia communicationdevice 103 shown in FIG. 1 is made up from: call process signalprocessor 1501, origination-side terminal data transmitter 202,termination-side terminal data receiver 204, origination-side terminaldata receiver 205, termination-side terminal data transmitter 206,transmission data character insertion unit 1502, and character stringdatabase 1503.

Call process signal processor 1501 carries out transmission andreception of call process signals between terminal 102-1 and terminal102-2. Call process signal processor 1501 also issues instructions totransmission data character insertion unit 1502 to read a characterstring from character string database 1503 at a prescribed time or atthe timing of reception of call process signals from terminal 102-1 orterminal 102-2. Call process signal processor 1501 also issuesinstructions to transmission data character insertion unit 1502 toinsert the character string that has been read from character stringdatabase 1503 into the encoded data to be transmitted to terminal 102-1at a prescribed time or at the timing of reception of call processsignals from terminal 102-1 or terminal 102-2. Call process signalprocessor 1501 can also use SIP of the IETF standard as the call processsignals.

Origination-side terminal data transmitter 202 transmits encoded datathat have been supplied from transmission data character insertion unit1502 to terminal 102-1. The processes in origination-side terminal datatransmitter 202 are the same as the processes in origination-sideterminal data transmitter 202 in the first to third embodiments.

Termination-side terminal data receiver 204 receives encoded data thathave been transmitted from terminal 102-2 and supplies the encoded datathat have been received to transmission data character insertion unit1502. The processes in termination-side terminal data receiver 204 arethe same as the processes in termination-side terminal data receiver 204in the first to third embodiments.

Origination-side terminal data receiver 205 receives the encoded datathat have been transmitted from terminal 102-1 and supplies the data totermination-side terminal data transmitter 206. The processes inorigination-side terminal data receiver 205 are the same as theprocesses in origination-side terminal data receiver 205 in the first tothird embodiments.

Termination-side terminal data transmitter 206 transmits encoded datathat have been supplied from origination-side terminal data receiver 205to terminal 102-2. The processes in termination-side terminal datatransmitter 206 are the same as the processes in termination-sideterminal data transmitter 206 in the first to third embodiments.

Conversion information database 208 is the same as in the first to thirdembodiments.

Transmission data character insertion unit 1502 reads character stringsfrom character string database 1503 in accordance with instructions fromcall process signal processor 1501 and inserts the character stringsthat have been read into encoded data that have been supplied fromtermination-side terminal data receiver 204. Transmission data characterinsertion unit 1502 then supplies the encoded data into which thecharacter strings have been inserted to origination-side terminal datatransmitter 202. The insertion of character strings here described is tosuperimpose the character strings on encoded data (images) that havebeen supplied from termination-side terminal data receiver 204. Thesynthesizing method may employ a method used in the related art.

FIG. 16 shows one configuration of transmission data character insertionunit 1502 shown in FIG. 15.

As shown in FIG. 16, transmission data character insertion unit 1502shown in FIG. 15 is composed of character string read unit 1601,insertion unit 1602, and data converter 1603.

Character string read unit 1601 reads a character string from characterstring database 1503 when instructions to read a character string fromcharacter string database 1503 are issued from call process signalprocessor 1501.

Insertion unit 1602 inserts a character string that has been read fromcharacter string database 1503 into encoded data that have been suppliedfrom termination-side terminal data receiver 204 when instructed fromcall process signal processor 1501 to insert a character string that hasbeen read from character string database 1503 into encoded data thathave been supplied from termination-side terminal data receiver 204.

Data converter 1603 converts encoded data into which a character stringhas been inserted in insertion unit 1602 to a data format that can bedecoded and reproduced in terminal 102-1 that is the origination-sideterminal. This conversion is realized by carrying out at least oneconversion of the conversion information that is stored in conversioninformation database 208. Data converter 1603 may further be provided ina stage preceding insertion unit 1602. In other words, the characterstring may be inserted into data that have been converted in dataconverter 1603. Alternatively, a configuration may be adopted in whichthis data converter 1603 is not included.

A character string is stored in advance in character string database1503. A plurality of character strings may be stored.

FIG. 17 shows the construction of character string database 1503 shownin FIG. 15.

As shown in FIG. 17, character string database 1503 shown in FIG. 15stores character strings. Each of the character strings is stored incorrespondence with an identification number that is individuallyconferred to each character string. For example, the character string“Good morning” is placed in correspondence with the identificationnumber “1001.” The character string “How are you?” is placed incorrespondence with the identification number “1002.” The characterstring “I've been accepted to a college!” is placed in correspondencewith the identification number “1003.”

In addition, attribute information of the character strings such ascolor, size, font may also be placed in correspondence with eachcharacter string that is stored in character string database 1503.

In addition, character string database 1503 may be connected outsidemultimedia communication device 103, and character strings may be readby multimedia communication device 103 as necessary.

Explanation next regards multimedia communication methods in multimediacommunication device 103 shown in FIG. 15.

FIG. 18 is a flow chart for explaining a multimedia communication methodin multimedia communication device 103 shown in FIG. 15.

First, in Step 41, when call process signal processor 1501 detects acall origination from terminal 102-1 to terminal 102-2 shown in FIG. 15,call process signal processor 1501 determines whether or not terminal102-2 that is the termination-side terminal has responded in Step 42.

If call process signal processor 1501 determines that terminal 102-2 hasresponded, call process signal processor 1501 issues instructions totransmission data character insertion unit 1502 to read a characterstring from character string database 1503 and to insert the characterstring that has been read into encoded data that have been supplied fromtermination-side terminal data receiver 204. In accordance with theseinstructions, a character string is read from character string database1503 by transmission data character insertion unit 1502 in Step 43.

At this time, the character string that is read may be a characterstring that is selected in accordance with the termination-sideterminal. In other words, correspondence between information foridentifying terminals 102-1-102-n and identification numbers ofcharacter strings may be stored in advance in character string database1503, and a character string may be selected and read in accordance withthis correspondence. For example, a case is described in whichinformation for identifying terminal 102-2 and the identification number“1002” are placed in correspondence. In this case, when thetermination-side terminal is terminal 102-2, the character string ofidentification number “1002” may be read. Alternatively, a characterstring may be selected and read in accordance with the origination-sideterminal. In this case, information for identifying the termination-sideterminal or origination-side terminal is supplied from call processsignal processor 1501 to transmission data character insertion unit1502. In this case, the information for identifying terminals102-1-102-n may be the telephone numbers of terminals 102-1-102-n or maybe any information that can identify terminals 102-1-102-n. In addition,the character string that is read at this time is a character stringthat can be displayed on terminal 102-1.

The character string that has been read is then inserted into theencoded data that have been supplied from termination-side terminal datareceiver 204, and the encoded data into which the character string hasbeen inserted are supplied to origination-side terminal data transmitter202 in Step 44. The position at which the character string can beinserted in the encoded data that have been supplied fromtermination-side terminal data receiver 204 is arbitrary and may be apredetermined position or may be a position designated from terminal102-1. In addition, when attribute information of a character string hasbeen stored in character string database 1503, the character string maybe inserted based on the attribute information of the character string.

The encoded data are then transmitted from origination-side terminaldata transmitter 202 to terminal 102-1 and the encoded data into whichthe character string has been inserted are reproduced on terminal 102-1.

When transmitting the encoded data to terminal 102-1, the encoded datamay be converted in data converter 303 shown in FIG. 3 as in the firstto third embodiments.

As described in the foregoing explanation, when a call is carried outfrom terminal 102-1 to terminal 102-2 in the present embodiment, aprescribed character string is inserted into the encoded data that aretransmitted from terminal 102-2 to terminal 102-1 and the encoded datainto which the character string has been inserted are reproduced onterminal 102-1 under conditions appropriate to terminal 102-1.

Fifth Embodiment

FIG. 19 shows the fifth embodiment of multimedia communication device103 shown in FIG. 1. An example is here described in which communicationis carried out between terminal 102-1 and terminal 102-2. Terminal 102-1is the origination-side terminal, and terminal 102-2 is thetermination-side terminal that is the communication partner of terminal102-1. The operations of terminals 102-3-102-n are the same as describedhereinbelow regardless of which terminals are the origination-sideterminal or the termination-side terminal.

As shown in FIG. 19, the fifth embodiment of multimedia communicationdevice 103 shown in FIG. 1 is made up from: call process signalprocessor 1901, origination-side terminal data transmitter 202,termination-side terminal data receiver 204, origination-side terminaldata receiver 205, termination-side terminal data transmitter 206,transmission data character insertion unit 1502, and character stringdatabase 1503.

Call process signal processor 1901 carries out the transmission andreception of call process signals between terminal 102-1 and terminal102-2. Call process signal processor 1901 further issues instructions totransmission data character insertion unit 1502 to read a characterstring from character string database 1503 at a prescribed time or atthe timing of reception of call process signals from terminal 102-1 orterminal 102-2. Call process signal processor 1901 further issuesinstructions to transmission data character insertion unit 1502 toinsert the character string that has been read from character stringdatabase 1503 into encoded data that are to be transmitted to terminal102-2 at a prescribed time or at the timing of reception of call processsignals from terminal 102-1 or terminal 102-2. Call process signalprocessor 1901 is capable of using, for example, SIP of the IETFstandard as call process signals.

Origination-side terminal data transmitter 202 transmits encoded datathat have been supplied from termination-side terminal data receiver 204to terminal 102-1. The processes in origination-side terminal datatransmitter 202 are the same as the processes in origination-sideterminal data transmitter 202 in the first to fourth embodiments.

Termination-side terminal data receiver 204 receives encoded data thathave been transmitted from terminal 102-2 and supplies the encoded datathat have been received to origination-side terminal data transmitter202. The processes in termination-side terminal data receiver 204 arethe same as the processes in termination-side terminal data receiver 204in the first to fourth embodiments.

Origination-side terminal data receiver 205 receives encoded data thathave been transmitted from terminal 102-1 and supplies the encoded datato transmission data character insertion unit 1502. The processes inorigination-side terminal data receiver 205 are the same as theprocesses in origination-side terminal data receiver 205 in the first tofourth embodiments.

Termination-side terminal data transmitter 206 transmits encoded datathat have been supplied from transmission data character insertion unit1502 to terminal 102-2. The processes in termination-side terminal datatransmitter 206 are the same as the processes in termination-sideterminal data transmitter 206 in the first to fourth embodiments.

Conversion information database 208 is the same as in the first tofourth embodiments.

In accordance with instructions from call process signal processor 1901,transmission data character insertion unit 1502 reads a character stringfrom character string database 1503 and inserts the character stringthat has been read into encoded data that have been supplied fromorigination-side terminal data receiver 205. Transmission data characterinsertion unit 1502 then supplies the encoded data into which thecharacter string has been inserted to termination-side terminal datatransmitter 206. The insertion of a character string is to superimposethe character string on encoded data (images) that have been suppliedfrom origination-side terminal data receiver 205. Regarding the methodof synthesis, a method is employed that is used in the related art. Theprocesses in transmission data character insertion unit 1502 are thesame as the processes in transmission data character insertion unit 1502in the fourth embodiment.

Character string database 1503 is the same as in the fourth embodiment.

Explanation next regards the multimedia communication method inmultimedia communication device 103 shown in FIG. 19.

FIG. 20 is a flow chart for explaining the multimedia communicationmethod in multimedia communication device 103 shown in FIG. 19.

First, upon detecting in Step 51 the call origination from terminal102-1 to terminal 102-2 shown in FIG. 19, call process signal processor1901 determines whether or not terminal 102-2 that is thetermination-side terminal has responded in Step 52.

If call process signal processor 1901 determines that terminal 102-2 hasresponded, call process signal processor 1901 issues instructions totransmission data character insertion unit 1502 to read a characterstring from character string database 1503 and to insert the characterstring that has been read into encoded data that have been supplied fromorigination-side terminal data receiver 205. In accordance with theseinstructions, a character string is read from character string database1503 by transmission data character insertion unit 1502 in Step 53.

The character string that is read at this time may be a character stringthat is selected in accordance with the termination-side terminal, as inthe fourth embodiment. Alternatively, a character string may be selectedand read in accordance with the origination-side terminal. The characterstring that is read at this time is a character string that can bedisplayed on terminal 102-2.

The character string that has been read is then inserted into encodeddata that have been supplied from origination-side terminal datareceiver 205, and the encoded data into which the character string hasbeen inserted are supplied to termination-side terminal data transmitter206 in Step 54. The position at which character string is inserted inthe encoded data that have been supplied from origination-side terminaldata receiver 205 is arbitrary and a position may be selected inadvance, or a position may be designated from terminal 102-1. Whenattribute information of the character string has been stored incharacter string database 1503, the character string may be insertedbased on the attribute information of the character string.

The encoded data are then transmitted from termination-side terminaldata transmitter 206 to terminal 102-2, and the encoded data into whichthe character string has been inserted are reproduced on terminal 102-2.

When encoded data are transmitted to terminal 102-2, the encoded datamay be converted in data converter 303 shown in FIG. 3 as in the firstto fourth embodiments.

When a call is carried out from terminal 102-1 to terminal 102-2 in thepresent embodiment as described hereinabove, a prescribed characterstring is inserted into the encoded data that are transmitted fromterminal 102-1 to terminal 102-2 and the encoded data into which thecharacter string has been inserted are reproduced on terminal 102-2under conditions appropriate to terminal 102-2.

Sixth Embodiment

Multimedia communication device 103 that is provided with both thefunctions of the fourth embodiment and the functions of the fifthembodiment that are described hereinabove can also be considered.

FIG. 21 shows the sixth embodiment of multimedia communication device103 shown in FIG. 1. An example is here described in which communicationtakes place between terminal 102-1 and terminal 102-2. Terminal 102-1 isthe origination-side terminal, and terminal 102-2 is thetermination-side terminal that is the communication partner of terminal102-1. The operations of terminals 102-3-102-n are the same as describedbelow regardless of which of terminals 102-3-102-n is theorigination-side terminal or the termination-side terminal.

As shown in FIG. 21, the sixth embodiment of multimedia communicationdevice 103 shown in FIG. 1 is made up from: call process signalprocessor 2101, origination-side terminal data transmitter 202,termination-side terminal data receiver 204, origination-side terminaldata receiver 205, termination-side terminal data transmitter 206,transmission data character insertion unit 2102, and character stringdatabase 1503.

Call process signal processor 2101 carries out transmission andreception of call process signals between terminal 102-1 and terminal102-2. Call process signal processor 2101 further issues instructions totransmission data character insertion unit 2102 to read a characterstring from character string database 1503 at a prescribed time or atthe timing of reception of call process signals from terminal 102-1 orterminal 102-2. Call process signal processor 2101 further issuesinstructions to transmission data character insertion unit 2102 toinsert the character string that has been read from character stringdatabase 1503 into the encoded data that are to be transmitted toterminals 102-1-102-2 at a prescribed time or at the timing of receptionof call process signals from terminal 102-1 or terminal 102-2. Callprocess signal processor 2101 is capable of using, for example, SIP ofthe IETF standard as call process signals.

Origination-side terminal data transmitter 202 transmits encoded datathat have been supplied from transmission data character insertion unit2102 to terminal 102-1. The processes in origination-side terminal datatransmitter 202 are the same as the processes in origination-sideterminal data transmitter 202 in the first to fifth embodiments.

Termination-side terminal data receiver 204 receives encoded data thathave been transmitted from terminal 102-2 and supplies the encoded datathat have been received to transmission data character insertion unit2102. The processes in termination-side terminal data receiver 204 arethe same as the processes in termination-side terminal data receiver 204in the first to fifth embodiments.

Origination-side terminal data receiver 205 receives encoded data thathave been transmitted from terminal 102-1 and supplies the encoded datato transmission data character insertion unit 2102. The processes inorigination-side terminal data receiver 205 are the same as theprocesses in origination-side terminal data receiver 205 in the first tofifth embodiments.

Termination-side terminal data transmitter 206 transmits encoded datathat have been supplied from transmission data character insertion unit2102 to terminal 102-2. The processes in termination-side terminal datatransmitter 206 are the same as the processes in termination-sideterminal data transmitter 206 of the first to fifth embodiments.

Conversion information database 208 is the same as in the first to fifthembodiments.

In accordance with instructions from call process signal processor 2101,transmission data character insertion unit 2102 reads a character stringfrom character string database 1503 and inserts the character stringthat has been read into encoded data that have been supplied fromorigination-side terminal data receiver 205. Transmission data characterinsertion unit 2102 then supplies the encoded data into which thecharacter string has been inserted to termination-side terminal datatransmitter 206. Transmission data character insertion unit 2102further, in accordance with instructions from call process signalprocessor 2101, inserts the character string that has been read intoencoded data that have been supplied from termination-side terminal datareceiver 204, and then supplies the encoded data into which thecharacter string has been inserted to origination-side terminal datatransmitter 202. Here, the insertion of a character string is tosuperimpose the character string on encoded data (images) that have beensupplied from termination-side terminal data receiver 204 ororigination-side terminal data receiver 205. The method of synthesisemploys a method used in the related art. Transmission data characterinsertion unit 2102 is of a form in which transmission data characterinsertion unit 1502 in the fourth and fifth embodiments is provided withthe two data directions: the data direction from the originator terminalto the terminator terminal and the data direction from the terminatorterminal to the originator terminal.

Character string database 1503 is the same as in the fourth and fifthembodiments.

By means of this form, multimedia communication device 103, that isprovided with both the functions of the fourth embodiment and thefunctions of the fifth embodiment, can be realized.

Seventh Embodiment

FIG. 22 shows the seventh embodiment of multimedia communication device103 shown in FIG. 1. An example is here described in which communicationis carried out between terminal 102-1 and terminal 102-2. Terminal 102-1is the origination-side terminal, and terminal 102-2 is thetermination-side terminal that is the communication partner of terminal102-1. The operations of terminals 102-3-102-n are the same as describedbelow regardless of which of terminals 102-3-102-n is theorigination-side terminal or the termination-side terminal.

As shown in FIG. 22, the seventh embodiment of multimedia communicationdevice 103 shown in FIG. 1 is composed of: DTMF signal detection unit2201, origination-side terminal data transmitter 202, transmission dataswitch unit 203, termination-side terminal data receiver 204,origination-side terminal data receiver 205, termination-side terminaldata transmitter 206, and content database 207.

DTMF signal detection unit 2201 detects a read signal that istransmitted from terminals 102-1-102-2. Here, a DTMF (Dual-ToneMulti-Frequency) signal is used as the read signal. In accordance withthe detected DTMF signal, DTMF signal detection unit 2201 issuesinstructions to transmission data switch unit 203 to read content fromcontent database 207. Further, in accordance with the detected DTMFsignal, DTMF signal detection unit 2201 issues instructions totransmission data switch unit 203 to transmit content that has been readfrom content database 207 to terminal 102-1. Alternatively, inaccordance with the detected DTMF signal, DTMF signal detection unit2201 issues instructions to transmission data switch unit 203 totransmit the encoded data that have been transmitted from terminal 102-2and received in multimedia communication device 103 to terminal 102-1.In addition, DTMF signal detection unit 2201 can also be configured as aDTMF signal packet (RFC2833 and RFC4733) receiver when, for example,network 101 is a packet-switched network.

Origination-side terminal data transmitter 202 transmits the encodeddata that have been supplied from transmission data switch unit 203 toterminal 102-1. The processes in origination-side terminal datatransmitter 202 are the same as the processes in origination-sideterminal data transmitter 202 in the first to sixth embodiments.

In accordance with instructions from DTMF signal detection unit 2201,transmission data switch unit 203 reads content from content database207 and encodes the content. Transmission data switch unit 203 also, inaccordance with instructions from DTMF signal detection unit 2201,switches the encoded data that are to be supplied to origination-sideterminal data transmitter 202 to either the encoded data of content thathas been read from content database 207 and has been encoded or encodeddata that have been supplied from termination-side terminal datareceiver 204 (encoded data that have been transmitted from terminal102-2). The processes in transmission data switch unit 203 are the sameas the processes in transmission data switch unit 203 in the firstembodiment.

Termination-side terminal data receiver 204 receives encoded data thathave been transmitted from terminal 102-2 and supplies the encoded datathat have been received to transmission data switch unit 203. Theprocesses in termination-side terminal data receiver 204 are the same asthe processes in termination-side terminal data receiver 204 in thefirst to sixth embodiments.

Origination-side terminal data receiver 205 receives the encoded datathat have been transmitted from terminal 102-1 and supplies the encodeddata to termination-side terminal data transmitter 206. The processes inorigination-side terminal data receiver 205 are the same as theprocesses in origination-side terminal data receiver 205 in the first tosixth embodiments.

Termination-side terminal data transmitter 206 transmits the encodeddata that have been supplied from origination-side terminal datareceiver 205 to terminal 102-2. The processes in termination-sideterminal data transmitter 206 are the same as the processes intermination-side terminal data transmitter 206 in the first to sixthembodiments.

Content database 207 is the same as in the first to third embodiments.

Conversion information database 208 is the same as in the first to sixthembodiments.

Explanation next regards the multimedia communication method in themultimedia communication device 103 shown in FIG. 22.

FIG. 23 is a flow chart for explaining the multimedia communicationmethod in multimedia communication device 103 shown in FIG. 22.

First, prescribed instructions realized by a DTMF signal from terminal102-1 or terminal 102-2 are detected in DTMF signal detection unit 2201in Step 61. The content of these instructions is set in advance, and theinput of prescribed keys of terminal 102-1 or terminal 102-2 by a usercauses a DTMF signal that corresponds to the input keys to betransmitted from terminal 102-1 or terminal 102-2. The DTMF signaltransmitted from terminal 102-1 or terminal 102-2 is then detected inDTMF signal detection unit 2201.

When the prescribed instructions realized by the DTMF signal fromterminal 102-1 or terminal 102-2 are detected in DTMF signal detectionunit 2201, instructions are issued from DTMF signal detection unit 2201to transmission data switch unit 203 to read content from contentdatabase 207 and encode the content to supply the encoded data toorigination-side terminal data transmitter 202. In accordance with theseinstructions, content is read from content database 207 and encoded bytransmission data switch unit 203 in Step 62, and the encoded data ofthe encoded content are supplied to origination-side terminal datatransmitter 202 in Step 63.

The encoded data of the content are then transmitted fromorigination-side terminal data transmitter 202 to terminal 102-1.

On the other hand, when prescribed instructions according to a DTMFsignal from terminal 102-1 or terminal 102-2 are not detected in DTMFsignal detection unit 2201, instructions are issued from DTMF signaldetection unit 2201 to transmission data switch unit 203 to supplyencoded data that have been supplied from termination-side terminal datareceiver 204 to origination-side terminal data transmitter 202. Inaccordance with these instructions, encoded data that have been suppliedfrom termination-side terminal data receiver 204 are supplied fromtransmission data switch unit 203 to origination-side terminal datatransmitter 202 in Step 64.

The encoded data are then transmitted from origination-side terminaldata transmitter 202 to terminal 102-1 and reproduced on terminal 102-1.

Differences in data formats that can be reproduced on each terminal ofterminals 102-1-102-n can also be considered. As a result, when theencoded data are to be transmitted to origination-side terminal datatransmitter 202, instructions may be issued from DTMF signal detectionunit 2201 to transmission data switch unit 203 to convert the encodeddata that are to be transmitted to a data format that can be decoded andreproduced on terminals 102-1-102-n that are the transmissiondestinations. In this case, the actual data conversion is carried out indata converter 303 of transmission data switch unit 203 shown in FIG. 3.

When the above-described instructions from DTMF signal detection unit2201 are implemented, the conversion information in terminal 102-1 thatis to reproduce the encoded data are read from conversion informationdatabase 208 by DTMF signal detection unit 2201. This conversioninformation has been placed in correspondence with the identificationnumber of terminal 102-1 that is contained in the call process signalsreceived in DTMF signal detection unit 2201. The conversion informationthat is read is supplied from DTMF signal detection unit 2201 totransmission data switch unit 203. Data conversion is then carried outin data converter 303 in transmission data switch unit 203 for theencoded data that are to be supplied from transmission data switch unit203 based on the conversion information, whereby encoded data that havebeen converted to a data format that can be decoded and reproduced interminal 102-1 are transmitted from origination-side terminal datatransmitter 202 to terminal 102-1. This data conversion process is thesame as shown in the first embodiment.

In this way, a prescribed DTMF signal is transmitted from terminal 102-1or terminal 102-2, whereby encoded data that are transmitted frommultimedia communication device 103 to terminal 102-1 in accordance withthe DTMF signal can be switched to either content that is read fromcontent database 207 or encoded data that have been transmitted fromterminal 102-2.

Eighth Embodiment

FIG. 24 shows the eighth embodiment of multimedia communication device103 shown in FIG. 1. An example is here described in which communicationis carried out between terminal 102-1 and terminal 102-2. Terminal 102-1is the origination-side terminal, and terminal 102-2 is thetermination-side terminal that is the communication partner of terminal102-1. The operations of terminals 102-3-102-n are the same as describedbelow regardless of which of terminals 102-3-102-n is theorigination-side terminal or the termination-side terminal.

As shown in FIG. 24, the eighth embodiment of multimedia communicationdevice 103 shown in FIG. 1 is made up from: DTMF signal detection unit2401, origination-side terminal data transmitter 202, transmission dataswitch unit 203, termination-side terminal data receiver 204,origination-side terminal data receiver 205, termination-side terminaldata transmitter 206, and content database 207.

DTMF signal detection unit 2401 detects read signals transmitted fromterminals 102-1-102-2. Here, DTMF signals are used as the read signals.In accordance with DTMF signals that are detected, DTMF signal detectionunit 2401 issues instructions to transmission data switch unit 203 toread content from content database 207. DTMF signal detection unit 2401further, in accordance with the DTMF signal that has been detected,issues instructions to transmission data switch unit 203 to transmitcontent that has been read from content database 207 to terminal 102-2,or to transmit encoded data that have been transmitted from terminal102-1 and received in multimedia communication device 103 to terminal102-2. In addition, DTMF signal detection unit 2401 can also beconfigured as a DTMF signal packet (RFC2833, RFC4733) receiver when, forexample, network 101 is a packet-switched network.

Origination-side terminal data transmitter 202 transmits encoded datathat have been supplied from termination-side terminal data receiver 204to terminal 102-1. The processes in origination-side terminal datatransmitter 202 are the same as the processes in origination-sideterminal data transmitter 202 in the first to seventh embodiments.

In accordance with instructions from DTMF signal detection unit 2401,transmission data switch unit 203 reads content from content database207 and encodes the content. Transmission data switch unit 203 further,in accordance with instructions from DTMF signal detection unit 2401,switches the encoded data that are to be supplied to termination-sideterminal data transmitter 206 to either encoded data of content that hasbeen read from content database 207 and has been encoded or encoded datathat have been supplied from origination-side terminal data receiver 205(encoded data that have been transmitted from terminal 102-1). Theprocesses in transmission data switch unit 203 are the same as theprocesses in transmission data switch unit 203 in the second embodiment.

Termination-side terminal data receiver 204 receives encoded data thathave been transmitted from terminal 102-2 and supplies the encoded datathat have been received to origination-side terminal data transmitter202. The processes in termination-side terminal data receiver 204 arethe same as the processes in termination-side terminal data receiver 204in the first to seventh embodiments.

Origination-side terminal data receiver 205 receives the encoded datathat have been transmitted from terminal 102-1 and supplies the encodeddata to transmission data switch unit 203. The processes inorigination-side terminal data receiver 205 are the same as theprocesses in origination-side terminal data receiver 205 in the first toseventh embodiments.

Termination-side terminal data transmitter 206 transmits the encodeddata that have been supplied from transmission data switch unit 203 toterminal 102-2. The processes in termination-side terminal datatransmitter 206 are the same as the processes in termination-sideterminal data transmitter 206 in the first to seventh embodiments.

Content database 207 is the same as in the seventh embodiment.

Conversion information database 208 is the same as in the first toseventh embodiments.

Explanation next regards the multimedia communication method inmultimedia communication device 103 shown in FIG. 24.

FIG. 25 is a flow chart for explaining the multimedia communicationmethod in multimedia communication device 103 shown in FIG. 24.

Prescribed instructions resulting from a DTMF signal from terminal 102-1or terminal 102-2 are first detected in DTMF signal detection unit 2401in Step 71. The content of these instructions is set in advance, and theinput of prescribed keys of terminal 102-1 or terminal 102-2 by a usercauses a DTMF signal that corresponds to the input keys to betransmitted from terminal 102-1 or terminal 102-2. The DTMF signaltransmitted from terminal 102-1 or terminal 102-2 is then detected inDTMF signal detection unit 2401.

When a prescribed instruction resulting from a DTMF signal from terminal102-1 or terminal 102-2 is detected in DTMF signal detection unit 2401,instructions are issued from DTMF signal detection unit 2401 totransmission data switch unit 203 to read content from content database207 and encode the content and to supply the data to termination-sideterminal data transmitter 206. In accordance with these instructions,transmission data switch unit 203 reads content from content database207 and encodes the content in Step 72, and supplies the encoded data ofthe encoded content to termination-side terminal data transmitter 206 inStep 73.

The encoded data of the content are then transmitted fromtermination-side terminal data transmitter 206 to terminal 102-2.

On the other hand, when a prescribed instruction realized by a DTMFsignal from terminal 102-1 or terminal 102-2 is not detected in DTMFsignal detection unit 2401, instructions are issued from DTMF signaldetection unit 2401 to transmission data switch unit 203 to supply theencoded data supplied from origination-side terminal data receiver 205to termination-side terminal data transmitter 206. In accordance withthese instructions, transmission data switch unit 203 supplies theencoded data that have been supplied from origination-side terminal datareceiver 205 to termination-side terminal data transmitter 206 in Step74.

The encoded data are then transmitted from termination-side terminaldata transmitter 206 to terminal 102-2 and reproduced on terminal 102-2.

Differences of the data format that can be reproduced on each terminalof terminals 102-1-102-n can also be considered. As a result, aconfiguration is also possible in which instructions are issued fromDTMF signal detection unit 2401 to transmission data switch unit 203such that, when encoded data are transmitted to termination-sideterminal data transmitter 206, the encoded data that are transmitted areconverted to a data format that can be decoded and reproduced interminals 102-1-102-n that are the transmission destinations and thensupplied. In this case, the actual data conversion is carried out indata converter 303 of transmission data switch unit 203 shown in FIG. 3.

When the above-described instructions are issued from DTMF signaldetection unit 2401, conversion information in terminal 102-2 that is toreproduce the encoded data is read from conversion information database208 by DTMF signal detection unit 2401. This conversion information isplaced in correspondence with the identification number of terminal102-2 that is contained in the call process signals received in DTMFsignal detection unit 2401. The conversion information that is read issupplied from DTMF signal detection unit 2401 to transmission dataswitch unit 203. Data conversion is then carried out in data converter303 in transmission data switch unit 203 for the encoded data that havebeen supplied from transmission data switch unit 203 based on theconversion information, whereby encoded data that have been converted toa data format that can be decoded and reproduced on terminal 102-2 aretransmitted from termination-side terminal data transmitter 206 toterminal 102-2. These data conversion processes are the same as shown inthe first embodiment.

In this way, a prescribed DTMF signal is transmitted from terminal 102-1or terminal 102-2, whereby encoded data that are to be transmitted frommultimedia communication device 103 to terminal 102-2 can be switched toeither content that is read from content database 207 or encoded datathat have been transmitted from terminal 102-1 in accordance with theDTMF signal.

Ninth Embodiment

Multimedia communication device 103, that is provided with both thecapabilities of the seventh embodiment and the capabilities of theeighth embodiment described hereinabove, can also be considered.

FIG. 26 shows the ninth embodiment of multimedia communication device103 shown in FIG. 1. An example is here described in which communicationis carried out between terminal 102-1 and terminal 102-2. Terminal 102-1is the origination-side terminal, and terminal 102-2 is thetermination-side terminal that is the communication partner of terminal102-1. The operations of terminals 102-3-102-n are the same as describedbelow regardless of which of terminals 102-3-102-n is theorigination-side terminal or the termination-side terminal.

As shown in FIG. 26, the ninth embodiment of multimedia communicationdevice 103 shown in FIG. 1 is composed of: DTMF signal detection unit2601, origination-side terminal data transmitter 202, termination-sideterminal data receiver 204, origination-side terminal data receiver 205,termination-side terminal data transmitter 206, content database 207,and transmission data switch unit 1402.

DTMF signal detection unit 2601 detects a read signal that has beentransmitted from terminals 102-1-102-2. Here, a DTMF signal is used asthe read signal. In addition, in accordance with the detected DTMFsignal, DTMF signal detection unit 2601 issues instructions totransmission data switch unit 1402 to read content from content database207. DTMF signal detection unit 2601 further, in accordance with thedetected DTMF signal, issues instructions to transmission data switchunit 1402 to transmit content that has been read from content database207 to terminal 102-2. Alternatively, DTMF signal detection unit 2601,in accordance with a detected DTMF signal, issues instructions totransmission data switch unit 1402 to transmit encoded data that havebeen transmitted from terminal 102-1 and received in multimediacommunication device 103 to terminal 102-2. DTMF signal detection unit2601 further, in accordance with the detected DTMF signal, issuesinstructions to transmission data switch unit 1402 to transmit thecontent that has been read from content database 207 to terminal 102-1.Alternatively, DTMF signal detection unit 2601, in accordance with thedetected DTMF signal, issues instructions to transmission data switchunit 1402 to transmit encoded data that have been transmitted fromterminal 102-2 and received in multimedia communication device 103 toterminal 102-1. DTMF signal detection unit 2601 can also be configuredas a DTMF signal packet (RFC2833, RFC4733) receiver when, for example,network 101 is a packet-switched network.

Origination-side terminal data transmitter 202 transmits encoded datathat have been supplied from transmission data switch unit 1402 toterminal 102-1. The processes in origination-side terminal datatransmitter 202 are the same as the processes in origination-sideterminal data transmitter 202 in the first to eighth embodiments.

Termination-side terminal data receiver 204 receives encoded data thathave been transmitted from terminal 102-2 and supplies the receivedencoded data to transmission data switch unit 1402. The processes intermination-side terminal data receiver 204 are the same as theprocesses in termination-side terminal data receiver 204 in the first toeighth embodiments.

Origination-side terminal data receiver 205 receives encoded data thathave been transmitted from terminal 102-1 and supplies the encoded datato transmission data switch unit 1402. The processes in origination-sideterminal data receiver 205 are the same as the processes inorigination-side terminal data receiver 205 in the first to eighthembodiments.

Termination-side terminal data transmitter 206 transmits encoded datathat have been supplied from transmission data switch unit 1402 toterminal 102-2. The processes in termination-side terminal datatransmitter 206 are the same as the processes in termination-sideterminal data transmitter 206 in the first to eighth embodiments.

Content database 207 is the same as in the seventh embodiment.

Conversion information database 208 is the same as in the first toeighth embodiments.

Transmission data switch unit 1402 reads content from content database207 and encodes the content in accordance with instructions from DTMFsignal detection unit 2601. Transmission data switch unit 1402 further,in accordance with instructions from DTMF signal detection unit 2601,switches encoded data that are to be supplied to termination-sideterminal data transmitter 206 to either encoded data of content that hasbeen read from content database 207 and has been encoded or encoded datathat have been supplied from origination-side terminal data receiver 205(encoded data that have been transmitted from terminal 102-1). Inaddition, transmission data switch unit 1402, in accordance withinstructions from DTMF signal detection unit 2601, switches encoded datathat are to supplied to origination-side terminal data transmitter 202to either encoded data of content that has been read from contentdatabase 207 and has been encoded or encoded data that have beensupplied from termination-side terminal data receiver 204 (encoded datathat have been transmitted from terminal 102-2). The processes intransmission data switch unit 1402 are the same as the processes intransmission data switch unit 1402 in the third embodiment.

This form enables the realization of multimedia communication device 103that is provided with both the capabilities of the seventh embodimentand the capabilities of the eighth embodiment.

Tenth Embodiment

FIG. 27 shows the tenth embodiment of multimedia communication device103 shown in FIG. 1. An example is here described in which communicationis carried out between terminal 102-1 and terminal 102-2. Terminal 102-1is the origination-side terminal, and terminal 102-2 is thetermination-side terminal that is the communication partner of terminal102-1. The operations of terminals 102-3-102-n are the same as describedhereinbelow regardless of which of terminals 102-3-102-n is theorigination-side terminal or the termination-side terminal.

As shown in FIG. 27, the tenth embodiment of multimedia communicationdevice 103 shown in FIG. 1 is composed of: DTMF signal detection unit2701, origination-side terminal data transmitter 202, termination-sideterminal data receiver 204, origination-side terminal data receiver 205,termination-side terminal data transmitter 206, transmission datacharacter insertion unit 1502, and character string database 1503.

DTMF signal detection unit 2701 detects a read signal transmitted fromterminal 102-1-102-2. Here, DTMF signals are used as the read signals.In accordance with a DTMF signal that has been detected, DTMF signaldetection unit 2701 issues instructions to transmission data characterinsertion unit 1502 to read a character string from character stringdatabase 1503. In addition, in accordance with a DTMF signal that hasbeen detected, DTMF signal detection unit 2701 issues instructions totransmission data character insertion unit 1502 to insert the characterstring that has been read from character string database 1503 intoencoded data that are to be transmitted to terminal 102-1. DTMF signaldetection unit 2701 can also be configured as a DTMF signal packet(RFC2833, RFC4733) receiver when, for example, network 101 is apacket-switched network.

Origination-side terminal data transmitter 202 transmits encoded datathat have been supplied from transmission data character insertion unit1502 to terminal 102-1. The processes in origination-side terminal datatransmitter 202 are the same as the processes in origination-sideterminal data transmitter 202 in the first to ninth embodiments.

Termination-side terminal data receiver 204 receives encoded data thathave been transmitted from terminal 102-2 and supplies the encoded datathat have been received to transmission data character insertion unit1502. The processes in termination-side terminal data receiver 204 arethe same as the processes in termination-side terminal data receiver 204of the first to ninth embodiments.

Origination-side terminal data receiver 205 receives encoded data thathave been transmitted from terminal 102-1 and supplies the encoded datato termination-side terminal data transmitter 206. The processes inorigination-side terminal data receiver 205 are the same as theprocesses in origination-side terminal data receiver 205 in the first toninth embodiments.

Termination-side terminal data transmitter 206 transmits encoded datathat have been supplied from origination-side terminal data receiver 205to terminal 102-2. The processes in termination-side terminal datatransmitter 206 are the same as the processes in termination-sideterminal data transmitter 206 in the first to ninth embodiments.

Conversion information database 208 is the same as in the first to ninthembodiments.

Transmission data character insertion unit 1502, in accordance withinstructions from DTMF signal detection unit 2701, reads a characterstring from character string database 1503 and inserts the characterstring that has been read into encoded data that have been supplied fromtermination-side terminal data receiver 204. Transmission data characterinsertion unit 1502 then supplies the encoded data into which thecharacter string has been inserted to origination-side terminal datatransmitter 202. In this case, the insertion of the character string isto superimpose the character string on encoded data (images) that havebeen supplied from termination-side terminal data receiver 204. Themethod of synthesis employs a method used in the related art. Theprocesses in transmission data character insertion unit 1502 are thesame as processes in transmission data character insertion unit 1502 inthe fourth embodiment.

Character string database 1503 is the same as in the fourth to sixthembodiments.

Explanation next regards the multimedia communication method inmultimedia communication device 103 shown in FIG. 27.

FIG. 28 is a flow chart for explaining the multimedia communicationmethod in multimedia communication device 103 shown in FIG. 27.

First, a prescribed instruction resulting from a DTMF signal fromterminal 102-1 or terminal 102-2 is detected in DTMF signal detectionunit 2701 in Step 81. The content of this instruction is set in advance,and a user performs input of prescribed keys in terminal 102-1 orterminal 102-2 to transmit a DTMF signal that corresponds to the keyinput from terminal 102-1 or terminal 102-2. The DTMF signal transmittedfrom terminal 102-1 or terminal 102-2 is detected in DTMF signaldetection unit 2701.

When a prescribed instruction resulting from a DTMF signal from terminal102-1 or terminal 102-2 is detected in DTMF signal detection unit 2701,instructions are issued from DTMF signal detection unit 2701 totransmission data character insertion unit 1502 to read a characterstring from character string database 1503 and to insert the characterstring that has been read into encoded data that have been supplied fromtermination-side terminal data receiver 204. In accordance with thisinstruction, a character string is read from character string database1503 by transmission data character insertion unit 1502 in Step 82. Thecharacter string that is read at this time is a character string thatcan be displayed on terminal 102-1. The character string that has beenread is inserted into encoded data that have been supplied fromtermination-side terminal data receiver 204, and the encoded data intowhich the character string has been inserted is supplied toorigination-side terminal data transmitter 202 in Step 83. The characterstring is inserted at any position in the encoded data that have beensupplied from termination-side terminal data receiver 204, and thisposition may be predetermined or may be a position that is designated byterminal 102-1 or terminal 102-2. If attribute information of thecharacter string is stored in character string database 1503, thecharacter string may be inserted based on the attribute information ofthe character string.

The encoded data are then transmitted from origination-side terminaldata transmitter 202 to terminal 102-1.

On the other hand, when a prescribed instruction resulting from a DTMFsignal from terminal 102-1 or terminal 102-2 is not detected in DTMFsignal detection unit 2701, instructions are issued from DTMF signaldetection unit 2701 to transmission data character insertion unit 1502to supply encoded data that have been supplied from termination-sideterminal data receiver 204 to origination-side terminal data transmitter202 without alteration. In accordance with these instructions, encodeddata that have been supplied from termination-side terminal datareceiver 204 are supplied to origination-side terminal data transmitter202 in Step 84 from transmission data character insertion unit 1502.

These encoded data are then transmitted from origination-side terminaldata transmitter 202 to terminal 102-1, and the encoded data into whicha character string has been inserted are reproduced on terminal 102-1.

When encoded data are transmitted to terminal 102-1, the encoded datamay be converted in data converter 303 shown in FIG. 3 as in the firstto ninth embodiments.

In this way, a prescribed DTMF signal is transmitted from terminal 102-1or terminal 102-2, whereby, in accordance with the DTMF signal, acharacter string that has been read from character string database 1503can be inserted into encoded data that are to be transmitted frommultimedia communication device 103 to terminal 102-1.

In the present embodiment described hereinabove, a prescribed DTMFsignal is transmitted from terminal 102-1 or terminal 102-2, whereby aprescribed character string is inserted into encoded data that are totransmitted to terminal 102-1 from terminal 102-2, and the encoded datainto which the character string has been inserted is reproduced onterminal 102-1 under conditions appropriate to terminal 102-1.

Eleventh Embodiment

FIG. 29 shows the eleventh embodiment of multimedia communication device103 shown in FIG. 1. An example is here described in which communicationis carried out between terminal 102-1 and terminal 102-2. Terminal 102-1is the origination-side terminal, and terminal 102-2 is thetermination-side terminal that is the communication partner of terminal102-1. The operations of terminals 102-3-102-n are the same as describedhereinbelow regardless of which of terminals 102-3-102-n is theorigination-side terminal or the termination-side terminal.

As shown in FIG. 29, the eleventh embodiment of multimedia communicationdevice 103 shown in FIG. 1 is made up from: DTMF signal detection unit2901, origination-side terminal data transmitter 202, termination-sideterminal data receiver 204, origination-side terminal data receiver 205,termination-side terminal data transmitter 206, transmission datacharacter insertion unit 1502, and character string database 1503.

DTMF signal detection unit 2901 detects a read signal transmitted fromterminals 102-1-102-2. Here, a DTMF signal is used as the read signal.Further, DTMF signal detection unit 2901, in accordance with the DTMFsignal that is detected, issues instructions to transmission datacharacter insertion unit 1502 to read a character string from characterstring database 1503. DTMF signal detection unit 2901 further, inaccordance with a detected DTMF signal, issues instructions totransmission data character insertion unit 1502 to insert a characterstring that has been read from character string database 1503 intoencoded data that are to be transmitted to terminal 102-2. DTMF signaldetection unit 2901 can also be configured as a DTMF signal packet(RFC2833, RFC4733) receiver when, for example, network 101 is apacket-switched network.

Origination-side terminal data transmitter 202 transmits encoded datathat have been supplied from termination-side terminal data receiver 204to terminal 102-1. The processes in origination-side terminal datatransmitter 202 are the same as the processes in origination-sideterminal data transmitter 202 in the first to tenth embodiments.

Termination-side terminal data receiver 204 receives encoded data thathave been transmitted from terminal 102-2 and supplies the receivedencoded data to origination-side terminal data transmitter 202. Theprocesses in termination-side terminal data receiver 204 are the same asthe processes in termination-side terminal data receiver 204 in thefirst to tenth embodiments.

Origination-side terminal data receiver 205 receives encoded data thathave been transmitted from terminal 102-1 and supplies the encoded datato transmission data character insertion unit 1502. The processes inorigination-side terminal data receiver 205 are the same as theprocesses in origination-side terminal data receiver 205 in the first totenth embodiments.

Termination-side terminal data transmitter 206 transmits encoded datathat have been supplied from transmission data character insertion unit1502 to terminal 102-2. The processes in termination-side terminal datatransmitter 206 are the same as the processes in termination-sideterminal data transmitter 206 in the first to tenth embodiments.

Conversion information database 208 is the same as in the first to tenthembodiments.

Transmission data character insertion unit 1502, in accordance withinstructions from DTMF signal detection unit 2901, reads a characterstring from character string database 1503 and inserts the characterstring that has been read into encoded data that have been supplied fromorigination-side terminal data receiver 205. Transmission data characterinsertion unit 1502 then supplies the encoded data into which thecharacter string has been inserted to termination-side terminal datatransmitter 206. The insertion of the character string in this case isto superimpose the character string on encoded data (images) that havebeen supplied from origination-side terminal data receiver 205. Thesynthesis method employs a method used in the related art. The processesin transmission data character insertion unit 1502 are the same as theprocesses in transmission data character insertion unit 1502 in thefifth embodiment.

Character string database 1503 is the same as in the fourth to sixthembodiments.

Explanation next regards the multimedia communication method inmultimedia communication device 103 shown in FIG. 29.

FIG. 30 is a flow chart for explaining the multimedia communicationmethod in multimedia communication device 103 shown in FIG. 29.

A prescribed instruction by means of a DTMF signal from terminal 102-1or terminal 102-2 is detected in DTMF signal detection unit 2901 in Step91. The content of this instruction is set in advance, and a user, byapplying input inputted by prescribed keys into terminal 102-1 or intoterminal 102-2, transmits a DTMF signal that corresponds to the keyinput from terminal 102-1 or terminal 102-2. The DTMF signal transmittedfrom terminal 102-1 or terminal 102-2 is then detected in DTMF signaldetection unit 2901.

When a prescribed instruction resulting from a DTMF signal from terminal102-1 or terminal 102-2 is detected in DTMF signal detection unit 2901,instructions are issued from DTMF signal detection unit 2901 totransmission data character insertion unit 1502 to read a characterstring from character string database 1503 and insert the characterstring that has been read into encoded data that have been supplied fromorigination-side terminal data receiver 205. In accordance with theseinstructions, a character string is read from character string database1503 by transmission data character insertion unit 1502 in Step 92. Thecharacter string that is read at this time is a character string thatcan be displayed on terminal 102-2. The character string that has beenread is inserted into encoded data that have been supplied fromorigination-side terminal data receiver 205, and the encoded data intowhich the character string has been inserted are supplied totermination-side terminal data transmitter 206 in Step 93. The characterstring can be inserted at any position of the encoded data that havebeen supplied from origination-side terminal data receiver 205, and thisposition may be a predetermined position or a position depending oninstructions from terminal 102-1 or terminal 102-2. Alternatively, whenattribute information of the character string is stored in characterstring database 1503, the character string may be inserted based on theattribute information of the character string.

The encoded data are then transmitted from termination-side terminaldata transmitter 206 to terminal 102-2.

On the other hand, when a prescribed instruction resulting from a DTMFsignal from terminal 102-1 or terminal 102-2 is not detected in DTMFsignal detection unit 2901, instructions are issued from DTMF signaldetection unit 2901 to transmission data character insertion unit 1502to supply encoded data that have been supplied from origination-sideterminal data receiver 205 without alteration to termination-sideterminal data transmitter 206. In accordance with these instructions,transmission data character insertion unit 1502 supplies encoded datathat have been supplied from origination-side terminal data receiver 205to termination-side terminal data transmitter 206 in Step 94.

The encoded data are then transmitted from termination-side terminaldata transmitter 206 to terminal 102-2, and encoded data into which acharacter string has been inserted are reproduced on terminal 102-2.

When transmitting encoded data to terminal 102-2, the encoded data maybe converted in data converter 303 shown in FIG. 3 as in the first totenth embodiments.

In this way, a prescribed DTMF signal is transmitted from terminal 102-1or terminal 102-2, whereby, in accordance with the DTMF signal, acharacter string that is read from character string database 1503 can beinserted into encoded data that are to be transmitted from multimediacommunication device 103 to terminal 102-2.

In the present embodiment as described hereinabove, the transmission ofa prescribed DTMF signal from terminal 102-1 or terminal 102-2 causes aprescribed character string to be inserted into encoded data that are totransmitted from terminal 102-1 to terminal 102-2 and causes the encodeddata into which the character string has been inserted to be reproducedon terminal 102-2 under conditions appropriate to terminal 102-2.

Twelfth Embodiment

A multimedia communication device 103, that is provided with both thecapabilities of the tenth embodiment and the capabilities of theeleventh embodiment described hereinabove, can also be considered.

FIG. 31 shows the twelfth embodiment of multimedia communication device103 shown in FIG. 1. An example is here described in which communicationis carried out between terminal 102-1 and terminal 102-2. Terminal 102-1is the origination-side terminal, and terminal 102-2 is thetermination-side terminal that is the communication partner of terminal102-1. The operations of each of terminals 102-3-102-n are the same asdescribed below regardless of which of terminals 102-3-102-n is theorigination-side terminal or the termination-side terminal.

As shown in FIG. 31, the twelfth embodiment of multimedia communicationdevice 103 shown in FIG. 1 is made up from: DTMF signal detection unit3101, origination-side terminal data transmitter 202, termination-sideterminal data receiver 204, origination-side terminal data receiver 205,termination-side terminal data transmitter 206, transmission datacharacter insertion unit 2102, and character string database 1503.

DTMF signal detection unit 3101 detects a read signal that istransmitted from terminals 102-1-102-2. Here, a DTMF signal is used asthe read signal. In accordance with the detected DTMF signal, DTMFsignal detection unit 3101 issues instructions to transmission datacharacter insertion unit 2102 to read a character string from characterstring database 1503. Further, in accordance with the detected DTMFsignal, DTMF signal detection unit 3101 issues instructions totransmission data character insertion unit 2102 to insert the characterstring that has been read from character string database 1503 intoencoded data that are to be transmitted to terminal 102-2. In addition,in accordance with the detected DTMF signal, DTMF signal detection unit3101 issues instructions to transmission data character insertion unit2102 to insert the character string that has been read from characterstring database 1503 into encoded data that are to be transmitted toterminal 102-1. DTMF signal detection unit 3101 can be configured as aDTMF signal packet (RFC2833, RFC4733) receiver when, for example,network 101 is a packet-switched network.

Origination-side terminal data transmitter 202 transmits encoded datathat have been supplied from transmission data character insertion unit2102 to terminal 102-1. The processes in origination-side terminal datatransmitter 202 are the same as the processes in origination-sideterminal data transmitter 202 of the first to eleventh embodiments.

Termination-side terminal data receiver 204 receives encoded data thathave been transmitted from terminal 102-2 and supplies the encoded datathat have been received to transmission data character insertion unit2102. The processes in termination-side terminal data receiver 204 arethe same as the processes in termination-side terminal data receiver 204in the first to eleventh embodiments.

Origination-side terminal data receiver 205 receives encoded data thathave been transmitted from terminal 102-1 and supplies the encoded datato transmission data character insertion unit 2102. The processes inorigination-side terminal data receiver 205 are the same as theprocesses in origination-side terminal data receiver 205 in the first toeleventh embodiments.

Termination-side terminal data transmitter 206 transmits encoded datathat have been supplied from transmission data character insertion unit2102 to terminal 102-2. The processes in termination-side terminal datatransmitter 206 are the same as the processes in termination-sideterminal data transmitter 206 in the first to eleventh embodiments.

Conversion information database 208 is the same as in the first toeleventh embodiments.

Transmission data character insertion unit 2102, in accordance withinstructions from DTMF signal detection unit 3101, reads a characterstring from character string database 1503 and inserts the characterstring that has been read into encoded data that have been supplied fromorigination-side terminal data receiver 205. Transmission data characterinsertion unit 2102 then supplies the encoded data into which thecharacter string has been inserted to termination-side terminal datatransmitter 206. In addition, in accordance with instructions from DTMFsignal detection unit 3101, transmission data character insertion unit2102 reads a character string from character string database 1503 andinserts the character string that has been read into encoded data thathave been supplied from termination-side terminal data receiver 204.Transmission data character insertion unit 2102 then supplies theencoded data into which the character string has been inserted toorigination-side terminal data transmitter 202. The insertion of acharacter string in this case is to superimpose the character string onencoded data (images) that have been supplied from origination-sideterminal data receiver 205 or termination-side terminal data receiver204. The method of synthesis employs a method used in the related art.The processes in transmission data character insertion unit 2102 are thesame as the processes in transmission data character insertion unit 2102in the sixth embodiment.

Character string database 1503 is the same as in the fourth to sixthembodiments.

By means of this embodiment, multimedia communication device 103 that isprovided with both the capabilities of the tenth embodiment and thecapabilities of the eleventh embodiment can be realized.

Multimedia communication device 103 in the above-described first totwelfth embodiments can obviously operate as a media server fordistributing content and character strings.

Thirteenth Embodiment

Multimedia communication device 103 described hereinabove can distributeadvertising content to terminals 102-1-102-n as a media server.

FIG. 32 shows the thirteenth embodiment of multimedia communicationdevice 103 shown in FIG. 1.

As shown in FIG. 32, media server 3201, which is a multimediacommunication device, is connected to a plurality of terminals102-1-102-n by way of network 101. Media server 3201 is furtherconnected to advertisement content database 3202. Terminals 102-1-102-nare communication terminals that can transmit and receive images andspeech, as represented by a videophone terminal. Terminals 102-1-102-nencode, as speech data, speech that is collected by a speech collectionmeans such as a microphone provided in terminals 102-1-102-n andtransmit the encoded speech data. In addition, terminals 102-1-102-nencode, as image data, images captured by a capture means such as acamera provided in terminals 102-1-102-n and transmit the encoded imagedata. In addition, terminals 102-1-102-n decode speech from speech datathat have been received and reproduce the decoded speech by means of aspeech reproduction means such as a speaker provided in terminals102-1-102-n. Terminals 102-1-102-n also decode images from image datathat have been received and reproduce the decoded images by means of animage reproduction means such as a display that is provided in terminals102-1-102-n.

Advertisement content database 3202 stores advertisement content that isto be distributed to terminals 102-1-102-n by way of network 101. Thisadvertisement content may be images or may be characters.

FIG. 33 shows a construction of advertisement content database 3202shown in FIG. 32.

As shown in FIG. 33, advertisement content database 3202 shown in FIG.32 stores advertisement character data and advertisement images asadvertisement data. An identification number that has been individuallyconferred to each item of data and a classification are stored incorrespondence with each item of advertisement data. For example, theidentification number “9001” and the classification “advertisementcharacter data” are placed in correspondence with the advertisement dataconstituted by the characters “∘∘ Electronics.” In addition, theidentification number “9002” and the classification “advertisementcharacter data” are placed in correspondence with the characteradvertisement data “□□ Shopping.” Further, the identification number“9003” and the classification “advertisement image” are placed incorrespondence with the advertisement data that is an image of atelevision. Still further, the identification number “9004” and theclassification “advertisement image” are placed in correspondence withthe advertisement data of a day trip to a hot spring. Advertisement datafor which the classification is “advertisement image” may be stillpictures or moving pictures.

Media server 3201 intermediates in the transfer of speech data and imagedata that are transmitted and received among terminals 102-1-102-n byway of network 101. In addition, media server 3201 reads advertisementcontent from advertisement content database 3202 and distributes theadvertisement content to terminals 102-1-102-n by way of network 101.During distribution, the advertisement content that has been read fromadvertisement content database 3202 may be distributed to terminals102-1-102-n without alteration. In addition, media server 3201 may alsoinsert advertisement content that has been read from advertisementcontent database 3202 into images that are transmitted and receivedamong terminals 102-1-102-n and may distribute the result. In this case,the data that are to be distributed may be converted to a data formatthat can be decoded and reproduced on terminals 102-1-102-n as in theabove-described first to twelfth embodiments.

For example, when advertisement data for which the classification is“advertisement character data” are read from advertisement contentdatabase 3202, the advertisement data may be imposed on telephonescreens in videophone communication among terminals 102-1-102-n using atranscoder. In this case, the advertisement data are displayedsuperposed on videophone images on the screens of terminals 102-1-102-nthat are engaged in videophone conversation. In addition, whenadvertisement data for which the classification is “advertisementimages” are read from advertisement content database 3202, theadvertisement data and videophone images may be partitioned and combinedin videophone calls among terminals 102-1-102-n using a transcoder. Inthis case, the advertisement data are displayed on a specified portionof the screens of terminals 102-1-102-n that are engaged in videophonecalls, and videophone images are displayed in other prescribed portions.This imposition or partitioned-combination is carried out intransmission data character insertion unit 2102 or transmission dataswitch unit 1402 of multimedia communication device 103.

In addition, the items of the advertisement data that are to besuperposed or partitioned and combined may be designated from terminals102-1-102-n or may be selected at random, no particular stipulationsbeing here imposed.

As a result, advertisement data can be combined in various formats.

In addition, the timing of the distribution of advertisement data is notlimited to times when terminals 102-1-102-n are engaged in calls, butmay also be when an originator terminal is calling a terminator terminalas in the first to sixth embodiments, or may be after calls of terminals102-1-102-n end.

The configuration of media server 3201 is the same as the configurationof multimedia communication device 103 described hereinabove.

Fourteenth Embodiment

FIG. 34 shows the fourteenth embodiment of multimedia communicationdevice 103 shown in FIG. 1.

As shown in FIG. 34, the present embodiment is formed by making mediaserver 3201, which is multimedia communication device 103, connectableto communication service provider device 3402, which belongs to acommunication service provider with whom the user who owns user terminal3403 is contracted. In addition, media server 3201 is connected toadvertisement content database 3202. Still further, communication ispossible between communication service provider device 3402 andadvertiser terminal 3401 that belongs to an advertiser.

The advertisement data of advertiser terminal 3401 are registered(stored) in advance in advertisement content database 3202 by advertiserterminal 3401. The advertisement data that are registered in thisadvertisement content database 3202 are managed by communication serviceprovider device 3402, whereby advertiser terminal 3401 pays anadvertisement fee to communication service provider device 3402.

Communication carried out by user terminal 3403 is carried out throughcommunication service provider device 3402 and media server 3201. Inthis case, communication service provider device 3402 uses media server3201 to read advertisement content from advertisement content database3202 and provides multimedia service to user terminal 3403, in the formof advertisement content, at least any one of images, speech, orcharacter string transmitted from media server 3201 to theorigination-side terminal or termination-side terminal belonging to userterminal 3403. More specifically, communication service provider device3402 issues instructions to media server 3201 to read advertisement datafrom advertisement content database 3202 and to insert thisadvertisement data into, or combine this advertisement data with, datathat are transmitted from media server 3201. Alternatively,communication service provider device 3402 issues instructions totransmit the advertisement data without alteration. Media server 3201then reads the advertisement data from advertisement content database3202, inserts the advertisement data into or combines the advertisementdata with the data that are transmitted from media server 3201, andtransmits the data to user terminal 3403. Alternatively, advertisementdata are transmitted to user terminal 3403 without alteration. Theseoperations of media server 3201 are the same as the operations ofmultimedia communication device 103 in the above-described seventh totwelfth embodiments. Multimedia communication device 103 in the seventhto twelfth embodiments read data from a database in accordance with aDTMF signal transmitted from terminals 102-1-102-2, but media server3201 in the present embodiment reads data from a database in accordancewith instructions from communication service provider device 3402.

When it is recorded in communication service provider device 3402 ormedia server 3201 that advertisement data have been transmitted to userterminal 3403, preferential treatment such as the reduction orcancellation of call charges is accorded to user terminal 3403 to whichthe advertisement data have been transmitted based on this record(transmission frequency). Preferential treatment information for givingpreferential treatment is stored in a preferential treatment database(not shown) that is provided in communication service provider device3402 or media server 3201, and when user terminal 3403 is billed forcall charges, this preferential treatment information may be read toadjust charges.

FIG. 35 shows the configuration of a preferential treatment database inwhich the number of transmissions of advertisement data and preferentialtreatment information are placed in correspondence.

As shown in FIG. 35, the number of transmissions of advertisement dataand the preferential treatment information for these transmissions arestored in correspondence. For example, preferential treatmentinformation for reducing call charges by ¥100 is stored for userterminal 3403 to which advertisement data have been transmitted 1-5times. In addition, preferential treatment information for reducing callcharges by ¥500 is stored for user terminal 3403 to which advertisementdata have been transmitted 6-10 times.

Preferential treatment information may also be effected according to thetransmission time interval of advertisement data.

FIG. 36 shows one configuration of a preferential treatment informationdatabase in which the transmission time interval of advertisement dataand preferential treatment information are stored in correspondence.

As shown in FIG. 36, the transmission time intervals of advertisementdata and the preferential treatment information for these cases arestored in correspondence. For example, preferential treatmentinformation for canceling call charges for one day is stored for userterminal 3403 for which the transmission time interval of advertisementdata is 1-3 minutes. In addition, preferential treatment information forcanceling call charges for two days is stored for user terminal 3403 forwhich the transmission time interval of advertisement data is 3-10minutes.

In this way, a user receives multimedia service provided from acommunication service provider, and by viewing advertisement content,receives a benefit such as the cancellation of call charges or thereduction of call charges according to the frequency of advertisementtransmission.

This preferential treatment information regarding call charges can alsobe applied in the above-described first to thirteenth embodiments.

In the above-described embodiments, the content or character strings canbe selected from terminals 102-1-102-n. For example, desired content orcharacter strings can be selected by applying the identification numberof content or a character string shown in FIG. 4 or FIG. 17 as input toterminals 102-1-102-n. Alternatively, a configuration may be adopted inwhich the above-described identification numbers are placed incorrespondence with respective terminals 102-1-102-n and content orcharacter strings that have been placed in correspondence with terminals102-1-102-n that originate or terminate calls are read and displayed. Inaddition, content that is stored in content database 207 and characterstrings that are stored in character string database 1503 are stored inadvance.

The above-described first to twelfth embodiments may also be combined inany combination as necessary.

For example, the present invention may be a method of providing amultimedia service in a multimedia communication system that is made upfrom a plurality of terminals and a server, the server being connectedto the plurality of terminals and to an advertisement content databasein which are stored advertisement data such as advertisement characterdata and advertisement images, and the server processing call processsignals of the plurality of terminals; the method including steps inwhich: the server reads advertisement character data from theadvertisement content database during videophone communication betweenterminals, the server imposes the advertisement character data that wasread onto a videophone screen; and the server transmits the videophonescreen on which advertisement character data have been imposed to atleast one of the terminals that are in videophone communication.

Alternatively, the present invention may be a method of providing amultimedia service in a multimedia communication system that is made upfrom a plurality of terminals and a server, the server being connectedto the plurality of terminals and to an advertisement content databasein which are stored advertisement data such as advertisement characterdata and advertisement images, and the server processing call processsignals of the plurality of terminals; the method including steps inwhich: the server reads advertisement images from the advertisementcontent database during videophone communication between terminals; theserver partitions and combines videophone images and advertisementimages that were read; and the server transmits a videophone screen inwhich advertisement images and videophone images have been partitionedand combined to at least one of the terminals that are in videophonecommunication.

Finally, the method of the present invention may includes steps inwhich: the server records in a preferential treatment informationdatabase the frequency (number of times or amount of time) oftransmission of videophone screens to at least one of terminals that arein videophone communication; and the server reads preferential treatmentinformation that accords with the frequency from the preferentialtreatment information database.

The invention of the present application was described with reference toembodiments, but the invention of the present application is not limitedto the above-described embodiments. The composition and details of theinvention of the present application are open to various modificationsthat will be clear to one skilled in the art and that are within thescope of the present invention.

This application is the National Phase of PCT/JP2008/061226 filed Jun.19, 2008 which claims priority that is based on Japanese PatentApplication 2007-194405 submitted Jul. 26, 2007 and incorporates all ofthe disclosures of that application.

What is claimed is:
 1. A method of providing a multimedia service in amultimedia communication system that is made up from a plurality ofterminals and a server, said server being connected to said plurality ofterminals, said server processing call process signals of said pluralityof terminals, and having a database in which are stored content data;said method comprising wherein: said server reads said content data fromsaid database at a timing when it is determined that communicationbetween said terminals has ended; at said timing, said server transmitssaid content data that were read to said terminals; at said timing, saidterminals reproduce content data that were transmitted from said server;said server records in a preferential treatment information database thefrequency of transmission of said content data to the origination-sideterminal that is said terminal that performs call origination; and saidserver reads from said preferential treatment information databasepreferential treatment information that accords with said frequency. 2.The method of providing a multimedia service according to claim 1,further comprising: at said timings, said server transmits said contentdata that were read to the termination-side terminal that is theterminal that is the communication partner of said terminal thatperforms call origination; and during the time interval until saidtermination-side terminal responds, said termination-side terminalreproduces content data that were transmitted from said server.
 3. Themethod of providing a multimedia service according to claim 2, furthercomprising wherein after said termination-side terminal responds, saidserver transmits data, that were transmitted from the origination-sideterminal that is said terminal that performs call origination, to saidtermination-side terminal.
 4. The method of providing a multimediaservice according to claim 1, further comprising: at said timing, saidserver reads said content data from said database and reproductionenvironment information indicating the reproduction environment of thecontent data that are stored together with said content data in saiddatabase; at said timing, said server transmits said content data andreproduction environment information that were read to theorigination-side terminal that is said terminal that performs callorigination; and at said timing, said origination-side terminalreproduces content data that were transmitted from said server based onsaid reproduction environment information.
 5. The method of providing amultimedia service according to claim 4, said method further comprisingwherein said server transmits to said origination-side terminalreproduction environment information of data that are transmitted fromsaid termination-side terminal that is the terminal that is thecommunication partner of said origination-side terminal.
 6. The methodof providing a multimedia service according to claim 4, furthercomprising wherein, after the termination-side terminal that is theterminal that is the communication partner of said origination-sideterminal responds, said server transmits to said origination-sideterminal data that were transmitted from said termination-side terminal.7. The method of providing a multimedia service according to claim 4,further comprising wherein said server uses SDP to process saidreproduction environment information.
 8. The method of providing amultimedia service according to claim 1, further comprising wherein saidserver uses SIP to process said call process signals.
 9. A method ofproviding a multimedia service in a multimedia communication system thatis made up from a plurality of terminals and a server, said server beingconnected to said plurality of terminals, said server processing callprocess signals of said plurality of terminals, and having a database inwhich are stored content data; said method comprising wherein: saidserver reads said content data from said database at a timing when it isdetermined that communication between said terminals has ended; at saidtiming, said server transmits said content data that were read to saidterminals; at said timing, said terminals reproduce content data thatwere transmitted from said server; said server records in a preferentialtreatment information database the frequency of transmission of saidcontent data to a termination-side terminal that is the terminal that isthe communication partner of said terminal that performs callorigination; and said server reads from said preferential treatmentinformation database preferential treatment information that accordswith said frequency.
 10. The method of providing a multimedia serviceaccording to claim 9, further comprising wherein: at said timings, saidserver transmits said content data that were read to thetermination-side terminal that is the terminal that is the communicationpartner of said terminal that performs call origination; and during thetime interval until said termination-side terminal responds, saidtermination-side terminal reproduces content data that were transmittedfrom said server.
 11. The method of providing a multimedia serviceaccording to claim 10, further comprising wherein after saidtermination-side terminal responds, said server transmits data, thatwere transmitted from the origination-side terminal that is saidterminal that performs call origination, to said termination-sideterminal.
 12. The method of providing a multimedia service according toclaim 9, further comprising wherein: at said timing, said server readssaid content data from said database and reproduction environmentinformation indicating the reproduction environment of the content datathat are stored together with said content data in said database; atsaid timing, said server transmits said content data and reproductionenvironment information that were read to the origination-side terminalthat is said terminal that performs call origination; and at saidtiming, said origination-side terminal reproduces content data that weretransmitted from said server based on said reproduction environmentinformation.
 13. The method of providing a multimedia service accordingto claim 12, said method further comprising wherein said servertransmits to said origination-side terminal reproduction environmentinformation of data that are transmitted from said termination-sideterminal that is the terminal that is the communication partner of saidorigination-side terminal.
 14. The method of providing a multimediaservice according to claim 12, further comprising wherein, after thetermination-side terminal that is the terminal that is the communicationpartner of said origination-side terminal responds, said servertransmits to said origination-side terminal data that were transmittedfrom said termination-side terminal.
 15. The method of providing amultimedia service according to claim 12, further comprising whereinsaid server uses SDP to process said reproduction environmentinformation.
 16. The method of providing a multimedia service accordingto claim 9, further comprising wherein said server uses SIP to processsaid call process signals.